Aug 27 03:33:13 devstack cinder-volume[83259]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 27 03:33:13 devstack cinder-volume[83259]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 27 03:33:13 devstack cinder-volume[83259]: we strongly recommend against using it for new projects. Aug 27 03:33:13 devstack cinder-volume[83259]: If you are already using Eventlet, we recommend migrating to a different Aug 27 03:33:13 devstack cinder-volume[83259]: framework. For more detail see Aug 27 03:33:13 devstack cinder-volume[83259]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 27 03:33:13 devstack cinder-volume[83259]: import eventlet # noqa Aug 27 03:33:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83259) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 27 03:33:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83259) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 27 03:33:15 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83259) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 27 03:33:16 devstack cinder-volume[83259]: INFO dbcounter [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Registered counter for database cinder Aug 27 03:33:16 devstack cinder-volume[83259]: DEBUG oslo_db.sqlalchemy.engines [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83259) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 27 03:33:16 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writer thread running {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 27 03:33:16 devstack cinder-volume[83259]: INFO cinder.rpc [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 27 03:33:16 devstack cinder-volume[83259]: INFO cinder.rpc [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 27 03:33:16 devstack cinder-volume[83259]: DEBUG oslo_db.sqlalchemy.engines [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83259) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 27 03:33:16 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Determined volume DB was empty at startup. Aug 27 03:33:16 devstack cinder-volume[83259]: DEBUG cinder.volume.manager [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83259) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 27 03:33:17 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 27 03:33:17 devstack cinder-volume[83259]: WARNING stevedore.named [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 27 03:33:17 devstack cinder-volume[83259]: WARNING castellan.key_manager [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 27 03:33:17 devstack cinder-volume[83259]: WARNING cinder.keymgr.conf_key_mgr [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG cinder.volume.drivers.lvm [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=83259) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=83259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_concurrency.processutils [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] CMD "cinder-rtstool verify" returned: 0 in 0.527s {{(pid=83259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_db.sqlalchemy.engines [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83259) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 27 03:33:17 devstack cinder-volume[83259]: INFO cinder.rpc [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 27 03:33:17 devstack cinder-volume[83259]: INFO cinder.rpc [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 27 03:33:17 devstack cinder-volume[83259]: WARNING stevedore.named [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 27 03:33:17 devstack cinder-volume[83259]: WARNING castellan.key_manager [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 27 03:33:17 devstack cinder-volume[83259]: INFO cinder.volume.manager [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_db.sqlalchemy.engines [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83259) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 27 03:33:17 devstack cinder-volume[83259]: INFO oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Starting 1 workers Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Started child 83421 {{(pid=83259) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Full set of CONF: {{(pid=83259) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] ******************************************************************************** {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Configuration options gathered from: {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] ================================================================================ {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] allow_availability_zone_fallback = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] allow_compression_on_image_upload = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] allowed_direct_url_schemes = [] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83421]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] api_rate_limit = True {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] auth_strategy = keystone {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] az_cache_duration = 3600 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_availability_zone = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_host = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_name = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_stats_polling_interval = 60 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backup_api_class = cinder.backup.api.API {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backup_name_template = backup-%s {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backup_use_same_host = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backup_use_temp_snapshot = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] chap_password = **** {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] chap_username = {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cinder_internal_tenant_project_id = 2c47caf6b1704dd88ff2459e0c226eb0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cinder_internal_tenant_user_id = a19ddda3472e43249a8e432f5a87e055 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cloned_volume_same_az = True {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cluster = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] compression_format = gzip {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] compute_api_class = cinder.compute.nova.API {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] config_dir = [] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] config_source = [] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] control_exchange = openstack {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] debug = True {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] default_availability_zone = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] default_group_type = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] default_volume_type = lvmdriver-1 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] disk_geometry = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] driver_client_cert = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] driver_client_cert_key = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] driver_data_namespace = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] driver_ssl_cert_path = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] driver_ssl_cert_verify = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] driver_use_ssl = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] enable_force_upload = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] enable_new_services = True {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] enable_unsupported_driver = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] enabled_backends = ['lvmdriver-1'] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] enforce_multipath_for_image_xfer = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] filter_function = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] glance_api_insecure = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] glance_api_servers = ['http://192.168.122.216/image'] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] glance_api_ssl_compression = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] glance_ca_certificates_file = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] glance_catalog_info = image:glance:publicURL {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] glance_certfile = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] glance_keyfile = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] glance_num_retries = 3 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] glance_request_timeout = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] goodness_function = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] graceful_shutdown_timeout = 5 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] group_api_class = cinder.group.api.API {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] host = devstack {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] image_compress_on_upload = True {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] image_conversion_address_space_limit = 1 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] image_conversion_cpu_limit = 60 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] image_conversion_disable = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] image_upload_use_cinder_backend = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] image_upload_use_internal_tenant = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] image_volume_cache_enabled = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] image_volume_cache_max_count = 0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] image_volume_cache_max_size_gb = 0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] init_host_max_objects_retrieval = 0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] instance_format = [instance: %(uuid)s] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] iscsi_target_flags = {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] iscsi_write_cache = on {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] iser_helper = tgtadm {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] iser_ip_address = 192.168.122.216 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] iser_port = 3260 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] log_color = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83421]: INFO cinder.volume.manager [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 27 03:33:17 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] log_config_append = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] log_dir = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] log_file = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] log_options = True {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] log_rotate_interval = 1 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] log_rotate_interval_type = days {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] log_rotation_type = none {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] max_age = 0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] max_logfile_count = 30 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] max_logfile_size_mb = 200 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] max_over_subscription_ratio = 20.0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] message_reap_interval = 86400 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] message_ttl = 2592000 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] migration_create_volume_timeout_secs = 300 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] monkey_patch = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] monkey_patch_modules = [] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] my_ip = 192.168.122.216 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] no_snapshot_gb_quota = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] num_iser_scan_tries = 3 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] num_shell_tries = 3 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] num_volume_device_scan_tries = 3 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] nvmeof_conn_info_version = 1 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] nvmet_ns_id = 10 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] nvmet_port_id = 1 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] osapi_max_limit = 1000 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] osapi_volume_ext_list = [] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] osapi_volume_listen_port = 8776 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] osapi_volume_use_ssl = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] osapi_volume_workers = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] per_volume_size_limit = -1 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] periodic_fuzzy_delay = 60 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] periodic_interval = 60 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] public_endpoint = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] publish_errors = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:17 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] quota_backup_gigabytes = 1000 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] quota_backups = 10 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] quota_gigabytes = 1000 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] quota_groups = 10 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] quota_snapshots = 10 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] quota_volumes = 10 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] rate_limit_burst = 0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] rate_limit_except_level = CRITICAL {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] rate_limit_interval = 0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] reinit_driver_count = 3 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] replication_device = **** {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] report_discard_supported = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] report_interval = 120 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] reservation_clean_interval = 86400 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] reservation_expire = 86400 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] reserved_image_namespaces = [] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] reserved_percentage = 0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] rpc_response_timeout = 120 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] run_external_periodic_tasks = True {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:17 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] scst_target_driver = iscsi {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] scst_target_iqn_name = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] service_down_time = 720 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] shell_completion = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] snapshot_name_template = snapshot-%s {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] snapshot_same_host = True {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] split_loggers = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] state_path = /opt/stack/data/cinder {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] storage_availability_zone = nova {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] storage_protocol = iSCSI {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] syslog_log_facility = LOG_USER {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] target_helper = lioadm {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] target_ip_address = 192.168.122.216 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] target_port = 3260 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] target_protocol = iscsi {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] target_secondary_ip_addresses = [] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] trace_flags = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] transport_url = **** {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] until_refresh = 0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] use_chap_auth = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] use_default_quota_class = True {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] use_journal = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] use_json = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] use_multipath_for_image_xfer = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] use_stderr = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] use_syslog = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack sudo[83425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] verify_glance_signatures = enabled {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack sudo[83425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] volume_api_class = cinder.volume.api.API {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] volume_backend_name = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] volume_clear = zero {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] volume_clear_ionice = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] volume_clear_size = 0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] volume_copy_bps_limit = 0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] volume_dd_blocksize = 1M {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] volume_name_template = volume-%s {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] volume_service_inithost_offload = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] volume_usage_audit_period = month {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] zoning_mode = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_concurrency.disable_process_locking = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.auth_section = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.auth_type = password {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.auth_version = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.cache = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.certfile = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.include_service_catalog = True {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.insecure = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.interface = public {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.keyfile = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.memcache_password = **** {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.memcache_username = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.region_name = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:17 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.service_type = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.216/identity {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.backend = dogpile.cache.null {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.backend_argument = **** {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.backend_expiration_time = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.config_prefix = cache.oslo {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.debug_cache_backend = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.enable_retry_client = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.enable_socket_keepalive = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.enabled = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.expiration_time = 600 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.hashclient_retry_attempts = 2 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.memcache_dead_retry = 300 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.memcache_pool_maxsize = 10 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.memcache_sasl_enabled = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.password = **** {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.proxies = [] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.redis_db = 0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.redis_server = localhost:6379 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.retry_attempts = 2 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.retry_delay = 0.0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.socket_keepalive_count = 1 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.socket_keepalive_idle = 1 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.socket_keepalive_interval = 1 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.socket_timeout = 1.0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.tls_allowed_ciphers = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.tls_cafile = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.tls_certfile = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.tls_enabled = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.tls_keyfile = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cache.username = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] coordination.backend_url = **** {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] database.asyncio_connection = **** {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] database.asyncio_slave_connection = **** {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] database.backend = sqlalchemy {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] database.connection = **** {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] database.connection_debug = 0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] database.connection_parameters = {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] database.connection_recycle_time = 3600 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] database.connection_trace = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] database.db_inc_retry_interval = True {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] database.db_max_retries = 20 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] database.db_max_retry_interval = 10 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] database.db_retry_interval = 1 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] database.max_overflow = 50 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] database.max_pool_size = 5 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] database.max_retries = 10 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] database.mysql_wsrep_sync_wait = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] database.pool_timeout = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] database.retry_interval = 10 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] database.slave_connection = **** {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] database.sqlite_synchronous = True {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] database.synchronous_reader = True {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] database.use_db_reconnect = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] profiler.connection_string = messaging:// {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] profiler.enabled = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] profiler.es_doc_type = notification {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] profiler.es_scroll_size = 10000 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] profiler.es_scroll_time = 2m {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] profiler.filter_error_trace = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] profiler.hmac_keys = **** {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] profiler.sentinel_service_name = mymaster {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] profiler.socket_timeout = 0.1 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] profiler.trace_requests = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] profiler.trace_sqlalchemy = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] profiler_jaeger.process_tags = {} {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] profiler_jaeger.service_name_prefix = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] profiler_otlp.service_name_prefix = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_policy.enforce_new_defaults = True {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_policy.policy_default_rule = default {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_policy.policy_file = policy.yaml {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] privsep_osbrick.group = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] privsep_osbrick.helper_command = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] privsep_osbrick.user = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cinder_sys_admin.group = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cinder_sys_admin.helper_command = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] cinder_sys_admin.user = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] service_user.auth_section = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] service_user.auth_type = password {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] service_user.cafile = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] service_user.certfile = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] service_user.collect_timing = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] service_user.insecure = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] service_user.keyfile = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] service_user.send_service_user_token = True {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] service_user.split_loggers = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] service_user.timeout = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] glance.auth_section = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] glance.auth_type = password {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] glance.certfile = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] glance.collect_timing = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] glance.insecure = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] glance.keyfile = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] glance.region_name = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] glance.split_loggers = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] glance.timeout = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.backend_availability_zone = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.chap_password = **** {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.chap_username = {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.disk_geometry = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.driver_client_cert = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.driver_client_cert_key = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.driver_data_namespace = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.driver_use_ssl = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.extra_capabilities = {} {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.filter_function = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.goodness_function = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.iscsi_target_flags = {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.iscsi_write_cache = on {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.iser_helper = tgtadm {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.iser_ip_address = 192.168.122.216 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.iser_port = 3260 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.lvm_mirrors = 0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.lvm_share_target = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.lvm_type = auto {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.num_shell_tries = 3 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.replication_device = **** {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.report_discard_supported = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.reserved_percentage = 0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.target_helper = tgtadm {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.target_ip_address = 192.168.122.216 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.target_port = 3260 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.target_protocol = iscsi {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.trace_flags = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.unique_fqdn_network = True {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.use_chap_auth = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.volume_backend_name = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.volume_clear = zero {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.volume_clear_ionice = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.volume_clear_size = 0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.volume_group = cinder-volumes {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_reports.file_event_handler = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_reports.log_dir = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.backend_availability_zone = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.backend_host = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.chap_password = **** {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.chap_username = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.chiscsi_conf = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.disk_geometry = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.driver_client_cert = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.driver_data_namespace = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.driver_use_ssl = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.extra_capabilities = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.filter_function = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.goodness_function = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.iser_helper = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.iser_ip_address = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.iser_port = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.iser_target_prefix = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.lvm_conf_file = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.lvm_mirrors = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.lvm_share_target = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.lvm_type = auto {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.num_shell_tries = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.nvmet_port_id = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.replication_device = **** {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.report_discard_supported = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.reserved_percentage = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.scst_target_driver = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.storage_protocol = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.target_helper = lioadm {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.target_ip_address = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.target_port = 3260 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.target_protocol = iscsi {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.trace_flags = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.use_chap_auth = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.volume_clear = zero {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.volume_clear_size = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] lvmdriver-1.volumes_dir = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.ssl = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_notifications.driver = [] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_notifications.retry = -1 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] key_manager.fixed_key = **** {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican.barbican_api_version = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican.barbican_endpoint = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican.barbican_endpoint_type = public {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican.barbican_region_name = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican.cafile = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican.certfile = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican.collect_timing = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican.insecure = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican.keyfile = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican.number_of_retries = 60 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican.retry_delay = 1 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican.send_service_user_token = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican.split_loggers = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican.timeout = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican.verify_ssl = True {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican.verify_ssl_path = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican_service_user.auth_section = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican_service_user.auth_type = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican_service_user.cafile = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican_service_user.certfile = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican_service_user.collect_timing = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican_service_user.insecure = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican_service_user.keyfile = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican_service_user.split_loggers = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] barbican_service_user.timeout = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] vault.approle_role_id = **** {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] vault.approle_secret_id = **** {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] vault.auth_method = approle {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] vault.auth_path = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] vault.kv_mountpoint = secret {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] vault.kv_path = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] vault.kv_version = 2 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] vault.namespace = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] vault.root_token_id = **** {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] vault.ssl_ca_crt_file = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] vault.timeout = 60.0 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] vault.token_file = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] vault.token_role = None {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] vault.use_ssl = False {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:33:18 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] ******************************************************************************** {{(pid=83259) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 27 03:33:18 devstack sudo[83425]: pam_unix(sudo:session): session closed for user root Aug 27 03:33:18 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.356s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:18 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:18 devstack sudo[83522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 27 03:33:18 devstack sudo[83522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:33:18 devstack sudo[83522]: pam_unix(sudo:session): session closed for user root Aug 27 03:33:18 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.296s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:18 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 27 03:33:18 devstack cinder-volume[83421]: INFO cinder.brick.local_dev.lvm [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 27 03:33:18 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:18 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:18 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:18 devstack sudo[83639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 27 03:33:18 devstack sudo[83639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:33:18 devstack sudo[83639]: pam_unix(sudo:session): session closed for user root Aug 27 03:33:18 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:18 devstack cinder-volume[83421]: DEBUG cinder.brick.local_dev.lvm [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=83421) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 27 03:33:18 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:18 devstack sudo[83737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 27 03:33:18 devstack sudo[83737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:33:19 devstack sudo[83737]: pam_unix(sudo:session): session closed for user root Aug 27 03:33:19 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.567s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:19 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:19 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:19 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:19 devstack sudo[83913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 27 03:33:19 devstack sudo[83913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:33:19 devstack sudo[83913]: pam_unix(sudo:session): session closed for user root Aug 27 03:33:19 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.360s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:19 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:19 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:19 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:19 devstack sudo[84037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 27 03:33:19 devstack sudo[84037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:33:20 devstack sudo[84037]: pam_unix(sudo:session): session closed for user root Aug 27 03:33:20 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.258s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:20 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:20 devstack sudo[84040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 27 03:33:20 devstack sudo[84040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:33:20 devstack sudo[84040]: pam_unix(sudo:session): session closed for user root Aug 27 03:33:20 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.329s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:20 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:20 devstack sudo[84125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 27 03:33:20 devstack sudo[84125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:33:20 devstack sudo[84125]: pam_unix(sudo:session): session closed for user root Aug 27 03:33:20 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:20 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:20 devstack sudo[84128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 27 03:33:20 devstack sudo[84128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:33:20 devstack sudo[84128]: pam_unix(sudo:session): session closed for user root Aug 27 03:33:20 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:20 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:21 devstack sudo[84170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 27 03:33:21 devstack sudo[84170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:33:21 devstack sudo[84170]: pam_unix(sudo:session): session closed for user root Aug 27 03:33:21 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.311s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:21 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:21 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:21 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:21 devstack sudo[84221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 27 03:33:21 devstack sudo[84221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:33:21 devstack sudo[84221]: pam_unix(sudo:session): session closed for user root Aug 27 03:33:21 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.237s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:21 devstack cinder-volume[83421]: INFO cinder.volume.drivers.lvm [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 27 03:33:21 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:21 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:21 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:21 devstack sudo[84225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 27 03:33:21 devstack sudo[84225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:33:21 devstack sudo[84225]: pam_unix(sudo:session): session closed for user root Aug 27 03:33:21 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:21 devstack cinder-volume[83421]: DEBUG cinder.volume.drivers.lvm [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Updating volume stats {{(pid=83421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 27 03:33:21 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:21 devstack sudo[84229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 27 03:33:21 devstack sudo[84229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:33:22 devstack sudo[84229]: pam_unix(sudo:session): session closed for user root Aug 27 03:33:22 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:22 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:22 devstack sudo[84241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 27 03:33:22 devstack sudo[84241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:33:22 devstack sudo[84241]: pam_unix(sudo:session): session closed for user root Aug 27 03:33:22 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:22 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:22 devstack sudo[84247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 27 03:33:22 devstack sudo[84247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:33:22 devstack sudo[84247]: pam_unix(sudo:session): session closed for user root Aug 27 03:33:22 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:22 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:22 devstack sudo[84250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 27 03:33:22 devstack sudo[84250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:33:22 devstack sudo[84250]: pam_unix(sudo:session): session closed for user root Aug 27 03:33:22 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:22 devstack cinder-volume[83421]: INFO cinder.volume.driver [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Driver hasn't implemented _init_vendor_properties() Aug 27 03:33:22 devstack cinder-volume[83421]: DEBUG cinder.volume.driver [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83421) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 27 03:33:22 devstack cinder-volume[83421]: DEBUG oslo_db.sqlalchemy.engines [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83421) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 27 03:33:22 devstack cinder-volume[83421]: DEBUG dbcounter [-] [83421] Writer thread running {{(pid=83421) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 27 03:33:23 devstack cinder-volume[83421]: DEBUG cinder.db.api [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Building query based on filter {{(pid=83421) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 27 03:33:23 devstack cinder-volume[83421]: DEBUG cinder.image.image_utils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83421) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 27 03:33:23 devstack cinder-volume[83421]: INFO cinder.keymgr.migration [None req-1888f14e-ecab-43b3-b5e2-d28b57f9cb51 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 27 03:33:23 devstack cinder-volume[83421]: DEBUG cinder.volume.drivers.lvm [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Updating volume stats {{(pid=83421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 27 03:33:23 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:23 devstack sudo[84253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 27 03:33:23 devstack sudo[84253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:33:23 devstack sudo[84253]: pam_unix(sudo:session): session closed for user root Aug 27 03:33:23 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:23 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:23 devstack sudo[84258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 27 03:33:23 devstack sudo[84258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:33:23 devstack sudo[84258]: pam_unix(sudo:session): session closed for user root Aug 27 03:33:23 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:23 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:23 devstack sudo[84261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 27 03:33:23 devstack sudo[84261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:33:23 devstack sudo[84261]: pam_unix(sudo:session): session closed for user root Aug 27 03:33:23 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:23 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:23 devstack sudo[84264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 27 03:33:23 devstack sudo[84264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:33:24 devstack sudo[84264]: pam_unix(sudo:session): session closed for user root Aug 27 03:33:24 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:24 devstack cinder-volume[83421]: DEBUG cinder.manager [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Notifying Schedulers of capabilities ... {{(pid=83421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:33:24 devstack cinder-volume[83421]: INFO cinder.volume.manager [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Driver initialization completed successfully. Aug 27 03:33:24 devstack cinder-volume[83421]: INFO cinder.manager [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Initiating service 2 cleanup Aug 27 03:33:24 devstack cinder-volume[83421]: INFO cinder.manager [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Service 2 cleanup completed. Aug 27 03:33:24 devstack cinder-volume[83421]: DEBUG cinder.service [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Creating RPC server for service cinder-volume {{(pid=83421) start /opt/stack/cinder/cinder/service.py:231}} Aug 27 03:33:24 devstack cinder-volume[83421]: DEBUG cinder.service [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83421) start /opt/stack/cinder/cinder/service.py:237}} Aug 27 03:33:24 devstack cinder-volume[83421]: INFO cinder.volume.manager [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 27 03:33:24 devstack cinder-volume[83421]: DEBUG cinder.volume.drivers.lvm [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Updating volume stats {{(pid=83421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 27 03:33:24 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:24 devstack sudo[84267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 27 03:33:24 devstack sudo[84267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:33:24 devstack sudo[84267]: pam_unix(sudo:session): session closed for user root Aug 27 03:33:24 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:24 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:24 devstack sudo[84272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 27 03:33:24 devstack sudo[84272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:33:24 devstack sudo[84272]: pam_unix(sudo:session): session closed for user root Aug 27 03:33:24 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:24 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:24 devstack sudo[84276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 27 03:33:24 devstack sudo[84276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:33:25 devstack sudo[84276]: pam_unix(sudo:session): session closed for user root Aug 27 03:33:25 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:25 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:33:25 devstack sudo[84279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 27 03:33:25 devstack sudo[84279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:33:25 devstack sudo[84279]: pam_unix(sudo:session): session closed for user root Aug 27 03:33:25 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:33:25 devstack cinder-volume[83421]: INFO cinder.volume.manager [None req-7e2424bc-77f2-4905-b5b9-3d0b5533039f None None] Driver post RPC initialization completed successfully. Aug 27 03:33:27 devstack cinder-volume[83259]: DEBUG dbcounter [-] [83259] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=83259) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:33:35 devstack cinder-volume[83421]: DEBUG dbcounter [-] [83421] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=83421) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:33:35 devstack cinder-volume[83421]: DEBUG dbcounter [-] [83421] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=83421) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:34:25 devstack cinder-volume[83421]: DEBUG oslo_service.periodic_task [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83421) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:34:25 devstack cinder-volume[83421]: DEBUG cinder.volume.drivers.lvm [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Updating volume stats {{(pid=83421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 27 03:34:25 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:34:25 devstack sudo[86309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 27 03:34:25 devstack sudo[86309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:34:25 devstack sudo[86309]: pam_unix(sudo:session): session closed for user root Aug 27 03:34:25 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:34:25 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:34:25 devstack sudo[86312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 27 03:34:25 devstack sudo[86312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:34:25 devstack sudo[86312]: pam_unix(sudo:session): session closed for user root Aug 27 03:34:25 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:34:25 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:34:25 devstack sudo[86315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 27 03:34:25 devstack sudo[86315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:34:26 devstack sudo[86315]: pam_unix(sudo:session): session closed for user root Aug 27 03:34:26 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:34:26 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:34:26 devstack sudo[86318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 27 03:34:26 devstack sudo[86318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:34:26 devstack sudo[86318]: pam_unix(sudo:session): session closed for user root Aug 27 03:34:26 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:34:26 devstack cinder-volume[83421]: DEBUG cinder.manager [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Notifying Schedulers of capabilities ... {{(pid=83421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:34:26 devstack cinder-volume[83421]: DEBUG oslo_service.periodic_task [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Running periodic task VolumeManager._thread_info {{(pid=83421) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:34:26 devstack cinder-volume[83421]: DEBUG cinder.volume.manager [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] thread count: 6 {{(pid=83421) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 03:34:26 devstack cinder-volume[83421]: DEBUG cinder.volume.manager [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] thread info: [<_MainThread(MainThread, started 124493470716032)>, , , , , ] {{(pid=83421) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 03:35:25 devstack cinder-volume[83421]: DEBUG oslo_service.periodic_task [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83421) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:35:25 devstack cinder-volume[83421]: DEBUG cinder.volume.drivers.lvm [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Updating volume stats {{(pid=83421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 27 03:35:25 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:35:25 devstack sudo[89672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 27 03:35:25 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:35:25 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root Aug 27 03:35:25 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:35:25 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:35:25 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 27 03:35:25 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:35:25 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Aug 27 03:35:25 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:35:25 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:35:25 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 27 03:35:25 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:35:26 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Aug 27 03:35:26 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:35:26 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:35:26 devstack sudo[89697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 27 03:35:26 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:35:26 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root Aug 27 03:35:26 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:35:26 devstack cinder-volume[83421]: DEBUG cinder.manager [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Notifying Schedulers of capabilities ... {{(pid=83421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:35:35 devstack cinder-volume[83421]: DEBUG dbcounter [-] [83421] Writing DB stats cinder:SELECT=1 {{(pid=83421) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:35:35 devstack cinder-volume[83421]: DEBUG dbcounter [-] [83421] Writing DB stats cinder:UPDATE=1 {{(pid=83421) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:36:25 devstack cinder-volume[83421]: DEBUG oslo_service.periodic_task [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83421) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:36:25 devstack cinder-volume[83421]: DEBUG cinder.volume.drivers.lvm [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Updating volume stats {{(pid=83421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 27 03:36:25 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:36:25 devstack sudo[91709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 27 03:36:25 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:36:25 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root Aug 27 03:36:25 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:36:25 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:36:25 devstack sudo[91712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 27 03:36:25 devstack sudo[91712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:36:25 devstack sudo[91712]: pam_unix(sudo:session): session closed for user root Aug 27 03:36:25 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:36:25 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:36:25 devstack sudo[91733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 27 03:36:25 devstack sudo[91733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:36:26 devstack sudo[91733]: pam_unix(sudo:session): session closed for user root Aug 27 03:36:26 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:36:26 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:36:26 devstack sudo[91741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 27 03:36:26 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:36:26 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root Aug 27 03:36:26 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:36:26 devstack cinder-volume[83421]: DEBUG cinder.manager [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Notifying Schedulers of capabilities ... {{(pid=83421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:36:26 devstack cinder-volume[83421]: DEBUG oslo_service.periodic_task [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Running periodic task VolumeManager._thread_info {{(pid=83421) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:36:26 devstack cinder-volume[83421]: DEBUG cinder.volume.manager [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] thread count: 6 {{(pid=83421) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 03:36:26 devstack cinder-volume[83421]: DEBUG cinder.volume.manager [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] thread info: [<_MainThread(MainThread, started 124493470716032)>, , , , , ] {{(pid=83421) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 03:37:25 devstack cinder-volume[83421]: DEBUG oslo_service.periodic_task [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83421) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:37:25 devstack cinder-volume[83421]: DEBUG cinder.volume.drivers.lvm [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Updating volume stats {{(pid=83421) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 27 03:37:25 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:37:25 devstack sudo[92929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 27 03:37:25 devstack sudo[92929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:37:25 devstack sudo[92929]: pam_unix(sudo:session): session closed for user root Aug 27 03:37:25 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:37:25 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:37:25 devstack sudo[92932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 27 03:37:25 devstack sudo[92932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:37:25 devstack sudo[92932]: pam_unix(sudo:session): session closed for user root Aug 27 03:37:25 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:37:25 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:37:25 devstack sudo[92938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 27 03:37:25 devstack sudo[92938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:37:26 devstack sudo[92938]: pam_unix(sudo:session): session closed for user root Aug 27 03:37:26 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:37:26 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:37:26 devstack sudo[92941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 27 03:37:26 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:37:26 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root Aug 27 03:37:26 devstack cinder-volume[83421]: DEBUG oslo_concurrency.processutils [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=83421) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:37:26 devstack cinder-volume[83421]: DEBUG cinder.manager [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Notifying Schedulers of capabilities ... {{(pid=83421) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:37:26 devstack cinder-volume[83421]: DEBUG oslo_service.periodic_task [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] Running periodic task VolumeManager._thread_info {{(pid=83421) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:37:26 devstack cinder-volume[83421]: DEBUG cinder.volume.manager [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] thread count: 6 {{(pid=83421) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 03:37:26 devstack cinder-volume[83421]: DEBUG cinder.volume.manager [None req-3a0ca60a-def8-49d3-a8d4-fac5420edea7 None None] thread info: [<_MainThread(MainThread, started 124493470716032)>, , , , , ] {{(pid=83421) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 03:37:35 devstack cinder-volume[83421]: DEBUG dbcounter [-] [83421] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83421) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:37:48 devstack cinder-volume[83259]: INFO oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Caught SIGTERM, stopping children Aug 27 03:37:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Acquiring lock "singleton_lock" {{(pid=83259) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 27 03:37:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Acquired lock "singleton_lock" {{(pid=83259) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 27 03:37:48 devstack cinder-volume[83259]: DEBUG oslo_concurrency.lockutils [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Releasing lock "singleton_lock" {{(pid=83259) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 27 03:37:48 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Stop services. {{(pid=83259) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 27 03:37:48 devstack cinder-volume[83259]: DEBUG oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Killing children. {{(pid=83259) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 27 03:37:48 devstack cinder-volume[83259]: INFO oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Waiting on 1 children to exit Aug 27 03:37:49 devstack cinder-volume[83421]: DEBUG oslo_concurrency.lockutils [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Acquiring lock "singleton_lock" {{(pid=83421) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 27 03:37:49 devstack cinder-volume[83421]: DEBUG oslo_concurrency.lockutils [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Acquired lock "singleton_lock" {{(pid=83421) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 27 03:37:49 devstack cinder-volume[83421]: DEBUG oslo_concurrency.lockutils [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Releasing lock "singleton_lock" {{(pid=83421) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 27 03:37:49 devstack cinder-volume[83421]: WARNING amqp [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 27 03:37:49 devstack cinder-volume[83421]: WARNING amqp [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 27 03:37:49 devstack cinder-volume[83259]: INFO oslo_service.backend._eventlet.service [None req-940329d2-28ee-41ea-8fc2-17670f292cf1 None None] Child 83421 exited with status 0 Aug 27 03:37:49 devstack cinder-volume[93513]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 27 03:37:49 devstack cinder-volume[93513]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 27 03:37:49 devstack cinder-volume[93513]: we strongly recommend against using it for new projects. Aug 27 03:37:49 devstack cinder-volume[93513]: If you are already using Eventlet, we recommend migrating to a different Aug 27 03:37:49 devstack cinder-volume[93513]: framework. For more detail see Aug 27 03:37:49 devstack cinder-volume[93513]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 27 03:37:49 devstack cinder-volume[93513]: import eventlet # noqa Aug 27 03:37:51 devstack cinder-volume[93513]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93513) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 27 03:37:51 devstack cinder-volume[93513]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93513) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 27 03:37:51 devstack cinder-volume[93513]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93513) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 27 03:37:52 devstack cinder-volume[93513]: INFO dbcounter [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Registered counter for database cinder Aug 27 03:37:52 devstack cinder-volume[93513]: DEBUG oslo_db.sqlalchemy.engines [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93513) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 27 03:37:52 devstack cinder-volume[93513]: DEBUG dbcounter [-] [93513] Writer thread running {{(pid=93513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 27 03:37:52 devstack cinder-volume[93513]: INFO cinder.rpc [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 27 03:37:52 devstack cinder-volume[93513]: INFO cinder.rpc [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 27 03:37:52 devstack cinder-volume[93513]: DEBUG oslo_db.sqlalchemy.engines [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93513) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 27 03:37:52 devstack cinder-volume[93513]: INFO cinder.volume.manager [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Determined volume DB was empty at startup. Aug 27 03:37:52 devstack cinder-volume[93513]: DEBUG cinder.volume.manager [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93513) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 27 03:37:52 devstack cinder-volume[93513]: INFO cinder.volume.manager [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 27 03:37:52 devstack cinder-volume[93513]: WARNING stevedore.named [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 27 03:37:52 devstack cinder-volume[93513]: WARNING castellan.key_manager [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 27 03:37:52 devstack cinder-volume[93513]: WARNING cinder.keymgr.conf_key_mgr [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 27 03:37:53 devstack cinder-volume[93513]: INFO cinder.volume.manager [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_db.sqlalchemy.engines [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93513) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 27 03:37:53 devstack cinder-volume[93513]: INFO oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Starting 1 workers Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Started child 93730 {{(pid=93513) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Full set of CONF: {{(pid=93513) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] ******************************************************************************** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Configuration options gathered from: {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] ================================================================================ {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] allow_availability_zone_fallback = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] allow_compression_on_image_upload = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] allowed_direct_url_schemes = [] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] api_rate_limit = True {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] auth_strategy = keystone {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_availability_zone = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_host = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_name = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_stats_polling_interval = 60 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backup_api_class = cinder.backup.api.API {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backup_name_template = backup-%s {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backup_use_same_host = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backup_use_temp_snapshot = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] chap_password = **** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] chap_username = {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cinder_internal_tenant_project_id = 2c47caf6b1704dd88ff2459e0c226eb0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cinder_internal_tenant_user_id = a19ddda3472e43249a8e432f5a87e055 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93730]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cluster = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] compression_format = gzip {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] compute_api_class = cinder.compute.nova.API {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] config_dir = [] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] config_source = [] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] control_exchange = openstack {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] debug = True {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] default_availability_zone = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] default_group_type = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] default_volume_type = QuobyteHD {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] disk_geometry = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] driver_client_cert = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] driver_client_cert_key = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] driver_data_namespace = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] driver_ssl_cert_path = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] driver_ssl_cert_verify = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] driver_use_ssl = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] enable_new_services = True {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] enable_unsupported_driver = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] enabled_backends = ['QuobyteHD'] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] enforce_multipath_for_image_xfer = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] filter_function = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] glance_api_insecure = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] glance_api_servers = ['http://192.168.122.216/image'] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] glance_api_ssl_compression = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] glance_ca_certificates_file = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] glance_catalog_info = image:glance:publicURL {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] glance_certfile = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] glance_keyfile = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] glance_num_retries = 3 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] glance_request_timeout = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] goodness_function = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] graceful_shutdown_timeout = 5 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] group_api_class = cinder.group.api.API {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] host = devstack {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] image_compress_on_upload = True {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] image_conversion_address_space_limit = 1 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] image_conversion_cpu_limit = 60 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] image_conversion_disable = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] image_upload_use_cinder_backend = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] image_upload_use_internal_tenant = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] image_volume_cache_enabled = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] image_volume_cache_max_count = 0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] image_volume_cache_max_size_gb = 0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] init_host_max_objects_retrieval = 0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] instance_format = [instance: %(uuid)s] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] iscsi_target_flags = {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] iscsi_write_cache = on {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] iser_helper = tgtadm {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] iser_ip_address = 192.168.122.216 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] iser_port = 3260 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] log_color = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] log_config_append = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] log_dir = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] log_file = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] log_options = True {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] log_rotate_interval = 1 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] log_rotate_interval_type = days {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] log_rotation_type = none {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] max_age = 0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] max_logfile_count = 30 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] max_logfile_size_mb = 200 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] max_over_subscription_ratio = 20.0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] message_reap_interval = 86400 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] message_ttl = 2592000 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] migration_create_volume_timeout_secs = 300 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] monkey_patch = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] monkey_patch_modules = [] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] my_ip = 192.168.122.216 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] no_snapshot_gb_quota = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] num_iser_scan_tries = 3 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] num_shell_tries = 3 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] num_volume_device_scan_tries = 3 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] nvmeof_conn_info_version = 1 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] nvmet_ns_id = 10 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] nvmet_port_id = 1 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] osapi_max_limit = 1000 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] osapi_volume_ext_list = [] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] osapi_volume_listen_port = 8776 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] osapi_volume_use_ssl = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] osapi_volume_workers = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] per_volume_size_limit = -1 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] periodic_fuzzy_delay = 60 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] periodic_interval = 60 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] public_endpoint = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] publish_errors = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] quota_backup_gigabytes = 1000 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] quota_backups = 10 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] quota_gigabytes = 1000 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] quota_groups = 10 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] quota_snapshots = 10 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] quota_volumes = 10 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] rate_limit_burst = 0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] rate_limit_except_level = CRITICAL {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] rate_limit_interval = 0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] reinit_driver_count = 3 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] replication_device = **** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] report_discard_supported = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] report_interval = 120 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] reservation_clean_interval = 86400 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] reservation_expire = 86400 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] reserved_image_namespaces = [] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] reserved_percentage = 0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] rpc_response_timeout = 120 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] run_external_periodic_tasks = True {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] scst_target_driver = iscsi {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] scst_target_iqn_name = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] service_down_time = 720 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] shell_completion = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] snapshot_name_template = snapshot-%s {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] split_loggers = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] state_path = /opt/stack/data/cinder {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] storage_availability_zone = nova {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] storage_protocol = iSCSI {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] syslog_log_facility = LOG_USER {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] target_helper = lioadm {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] target_ip_address = 192.168.122.216 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] target_port = 3260 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] target_protocol = iscsi {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] target_secondary_ip_addresses = [] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] trace_flags = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] transport_url = **** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] until_refresh = 0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] use_chap_auth = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] use_default_quota_class = True {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] use_journal = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] use_json = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] use_multipath_for_image_xfer = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] use_stderr = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] use_syslog = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] verify_glance_signatures = enabled {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] volume_api_class = cinder.volume.api.API {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] volume_backend_name = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] volume_clear = zero {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] volume_clear_ionice = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] volume_clear_size = 0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] volume_copy_bps_limit = 0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] volume_dd_blocksize = 1M {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] volume_name_template = volume-%s {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] volume_service_inithost_offload = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] volume_usage_audit_period = month {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] zoning_mode = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_concurrency.disable_process_locking = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93730]: INFO cinder.volume.manager [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Starting volume driver QuobyteDriver (1.2.1) Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93730]: DEBUG cinder.volume.drivers.remotefs [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93730) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.auth_section = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.auth_type = password {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.auth_version = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.cache = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.certfile = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.include_service_catalog = True {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.insecure = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.interface = public {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.keyfile = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.memcache_password = **** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.memcache_username = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.region_name = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.service_type = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.216/identity {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.backend = dogpile.cache.null {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.backend_argument = **** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.backend_expiration_time = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.config_prefix = cache.oslo {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.debug_cache_backend = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.enable_retry_client = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.enable_socket_keepalive = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.enabled = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.expiration_time = 600 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.hashclient_retry_attempts = 2 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.memcache_dead_retry = 300 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.memcache_pool_maxsize = 10 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.memcache_sasl_enabled = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.password = **** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.proxies = [] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.redis_db = 0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.redis_server = localhost:6379 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.retry_attempts = 2 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.retry_delay = 0.0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.socket_keepalive_count = 1 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.socket_keepalive_idle = 1 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.socket_keepalive_interval = 1 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.socket_timeout = 1.0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.tls_allowed_ciphers = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.tls_cafile = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.tls_certfile = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.tls_enabled = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.tls_keyfile = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cache.username = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] coordination.backend_url = **** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] database.asyncio_connection = **** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] database.asyncio_slave_connection = **** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] database.backend = sqlalchemy {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] database.connection = **** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] database.connection_debug = 0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] database.connection_parameters = {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] database.connection_recycle_time = 3600 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] database.connection_trace = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] database.db_inc_retry_interval = True {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] database.db_max_retries = 20 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] database.db_max_retry_interval = 10 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] database.db_retry_interval = 1 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] database.max_overflow = 50 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] database.max_pool_size = 5 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] database.max_retries = 10 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] database.mysql_wsrep_sync_wait = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] database.pool_timeout = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] database.retry_interval = 10 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] database.slave_connection = **** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] database.sqlite_synchronous = True {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] database.synchronous_reader = True {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] database.use_db_reconnect = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] profiler.connection_string = messaging:// {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] profiler.enabled = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] profiler.es_doc_type = notification {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] profiler.es_scroll_size = 10000 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] profiler.es_scroll_time = 2m {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] profiler.filter_error_trace = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] profiler.hmac_keys = **** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] profiler.sentinel_service_name = mymaster {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] profiler.socket_timeout = 0.1 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] profiler.trace_requests = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] profiler.trace_sqlalchemy = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] profiler_jaeger.process_tags = {} {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] profiler_jaeger.service_name_prefix = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] profiler_otlp.service_name_prefix = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_policy.enforce_new_defaults = True {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_policy.policy_default_rule = default {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_policy.policy_file = policy.yaml {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] privsep_osbrick.group = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] privsep_osbrick.helper_command = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] privsep_osbrick.user = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cinder_sys_admin.group = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cinder_sys_admin.helper_command = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] cinder_sys_admin.user = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] service_user.auth_section = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] service_user.auth_type = password {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] service_user.cafile = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] service_user.certfile = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] service_user.collect_timing = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] service_user.insecure = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] service_user.keyfile = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] service_user.send_service_user_token = True {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] service_user.split_loggers = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] service_user.timeout = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] glance.auth_section = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] glance.auth_type = password {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] glance.certfile = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] glance.collect_timing = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] glance.insecure = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] glance.keyfile = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] glance.region_name = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] glance.split_loggers = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] glance.timeout = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.backend_availability_zone = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.chap_password = **** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.chap_username = {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.disk_geometry = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.driver_client_cert = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.driver_client_cert_key = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.driver_data_namespace = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.driver_use_ssl = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.extra_capabilities = {} {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.filter_function = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.goodness_function = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.iscsi_target_flags = {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.iscsi_write_cache = on {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.iser_helper = tgtadm {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.iser_ip_address = 192.168.122.216 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.iser_port = 3260 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.nas_host = {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.nas_login = admin {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.nas_mount_options = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.nas_password = **** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.nas_private_key = {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.nas_share_path = {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.num_shell_tries = 3 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.quobyte_volume_url = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.replication_device = **** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.report_discard_supported = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.reserved_percentage = 0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.target_helper = tgtadm {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.target_ip_address = 192.168.122.216 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.target_port = 3260 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.target_protocol = iscsi {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.trace_flags = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.unique_fqdn_network = True {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.use_chap_auth = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.volume_backend_name = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.volume_clear = zero {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.volume_clear_ionice = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.volume_clear_size = 0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_reports.file_event_handler = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_reports.log_dir = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.backend_availability_zone = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.backend_host = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.chap_password = **** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.chap_username = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.chiscsi_conf = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.disk_geometry = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.driver_client_cert = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.driver_data_namespace = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.driver_use_ssl = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.extra_capabilities = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.filter_function = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.goodness_function = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.iser_helper = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.iser_ip_address = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.iser_port = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.iser_target_prefix = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.nas_host = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.nas_login = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.nas_mount_options = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.nas_password = **** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.nas_private_key = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.nas_share_path = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.nas_ssh_port = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.num_shell_tries = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.nvmet_port_id = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.replication_device = **** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.report_discard_supported = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.reserved_percentage = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.scst_target_driver = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.storage_protocol = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.target_helper = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.target_ip_address = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.target_port = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.target_prefix = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.target_protocol = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.trace_flags = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.use_chap_auth = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.volume_clear = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.volume_clear_size = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] QuobyteHD.volumes_dir = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93730]: DEBUG cinder.volume.drivers.quobyte [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93730) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93730]: WARNING cinder.volume.drivers.quobyte [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.ssl = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_notifications.driver = [] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_notifications.retry = -1 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] key_manager.fixed_key = **** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican.barbican_api_version = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican.barbican_endpoint = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican.barbican_endpoint_type = public {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican.barbican_region_name = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93730]: WARNING cinder.volume.drivers.quobyte [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican.cafile = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican.certfile = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican.collect_timing = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican.insecure = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican.keyfile = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican.number_of_retries = 60 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican.retry_delay = 1 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican.send_service_user_token = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican.split_loggers = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican.timeout = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican.verify_ssl = True {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican.verify_ssl_path = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican_service_user.auth_section = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican_service_user.auth_type = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican_service_user.cafile = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican_service_user.certfile = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican_service_user.collect_timing = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican_service_user.insecure = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican_service_user.keyfile = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican_service_user.split_loggers = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] barbican_service_user.timeout = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] vault.approle_role_id = **** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] vault.approle_secret_id = **** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] vault.auth_method = approle {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] vault.auth_path = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] vault.kv_mountpoint = secret {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] vault.kv_path = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] vault.kv_version = 2 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] vault.namespace = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] vault.root_token_id = **** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] vault.ssl_ca_crt_file = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] vault.timeout = 60.0 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] vault.token_file = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] vault.token_role = None {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] vault.use_ssl = False {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93730]: DEBUG oslo_concurrency.processutils [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Running cmd (subprocess): mount.quobyte {{(pid=93730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:37:53 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] ******************************************************************************** {{(pid=93513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 27 03:37:53 devstack quobyte-client[93733]: Reading configuration file: /etc/quobyte/client.cfg Aug 27 03:37:53 devstack quobyte-client[93733]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 27 03:37:53 devstack cinder-volume[93730]: DEBUG oslo_concurrency.processutils [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] CMD "mount.quobyte" returned: 1 in 0.122s {{(pid=93730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:37:53 devstack cinder-volume[93730]: DEBUG oslo_concurrency.lockutils [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93730) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:37:53 devstack cinder-volume[93730]: DEBUG oslo_concurrency.lockutils [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93730) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:37:53 devstack cinder-volume[93730]: DEBUG cinder.volume.drivers.quobyte [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=93730) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:37:53 devstack cinder-volume[93730]: INFO cinder.volume.drivers.quobyte [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac ... Aug 27 03:37:53 devstack cinder-volume[93730]: DEBUG oslo_concurrency.processutils [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 -c /etc/quobyte/client-cinder.cfg {{(pid=93730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:37:53 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 -c /etc/quobyte/client-cinder.cfg Aug 27 03:37:53 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:37:53 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Aug 27 03:37:53 devstack cinder-volume[93730]: DEBUG oslo_concurrency.processutils [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.380s {{(pid=93730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:37:53 devstack cinder-volume[93730]: INFO cinder.volume.drivers.quobyte [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac succeeded Aug 27 03:37:53 devstack cinder-volume[93730]: DEBUG cinder.volume.drivers.quobyte [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=93730) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:37:53 devstack cinder-volume[93730]: DEBUG oslo_concurrency.lockutils [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.398s {{(pid=93730) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:37:53 devstack cinder-volume[93730]: DEBUG oslo_concurrency.processutils [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=93730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:37:53 devstack sudo[93805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:37:53 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:37:54 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root Aug 27 03:37:54 devstack cinder-volume[93730]: DEBUG oslo_concurrency.processutils [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.247s {{(pid=93730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:37:54 devstack cinder-volume[93730]: INFO cinder.volume.driver [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Driver hasn't implemented _init_vendor_properties() Aug 27 03:37:54 devstack cinder-volume[93730]: DEBUG cinder.volume.driver [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.7293586730957, 'free_capacity_gb': 1774.7293586730957, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93730) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 27 03:37:54 devstack cinder-volume[93730]: DEBUG oslo_db.sqlalchemy.engines [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93730) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 27 03:37:54 devstack cinder-volume[93730]: DEBUG dbcounter [-] [93730] Writer thread running {{(pid=93730) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 27 03:37:54 devstack cinder-volume[93730]: DEBUG cinder.db.api [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Building query based on filter {{(pid=93730) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 27 03:37:54 devstack cinder-volume[93730]: DEBUG cinder.image.image_utils [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93730) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 27 03:37:54 devstack cinder-volume[93730]: INFO cinder.keymgr.migration [None req-75cbcdc7-54ec-43bb-9d0b-06ec5abfdff0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 27 03:37:54 devstack cinder-volume[93730]: DEBUG oslo_concurrency.lockutils [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93730) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:37:54 devstack cinder-volume[93730]: DEBUG oslo_concurrency.lockutils [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93730) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:37:54 devstack cinder-volume[93730]: DEBUG cinder.volume.drivers.quobyte [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=93730) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:37:54 devstack cinder-volume[93730]: DEBUG cinder.volume.drivers.quobyte [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=93730) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:37:54 devstack cinder-volume[93730]: DEBUG oslo_concurrency.lockutils [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93730) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:37:54 devstack cinder-volume[93730]: DEBUG oslo_concurrency.processutils [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=93730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:37:54 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:37:54 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:37:54 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Aug 27 03:37:54 devstack cinder-volume[93730]: DEBUG oslo_concurrency.processutils [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.231s {{(pid=93730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:37:54 devstack cinder-volume[93730]: DEBUG cinder.manager [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Notifying Schedulers of capabilities ... {{(pid=93730) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:37:54 devstack cinder-volume[93730]: INFO cinder.volume.manager [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Driver initialization completed successfully. Aug 27 03:37:54 devstack cinder-volume[93730]: INFO cinder.manager [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Initiating service 3 cleanup Aug 27 03:37:54 devstack cinder-volume[93730]: INFO cinder.manager [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Service 3 cleanup completed. Aug 27 03:37:54 devstack cinder-volume[93730]: DEBUG cinder.service [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Creating RPC server for service cinder-volume {{(pid=93730) start /opt/stack/cinder/cinder/service.py:231}} Aug 27 03:37:54 devstack cinder-volume[93730]: DEBUG cinder.service [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93730) start /opt/stack/cinder/cinder/service.py:237}} Aug 27 03:37:54 devstack cinder-volume[93730]: INFO cinder.volume.manager [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 27 03:37:54 devstack cinder-volume[93730]: DEBUG oslo_concurrency.lockutils [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93730) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:37:54 devstack cinder-volume[93730]: DEBUG oslo_concurrency.lockutils [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93730) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:37:54 devstack cinder-volume[93730]: DEBUG cinder.volume.drivers.quobyte [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=93730) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:37:54 devstack cinder-volume[93730]: DEBUG cinder.volume.drivers.quobyte [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=93730) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:37:54 devstack cinder-volume[93730]: DEBUG oslo_concurrency.lockutils [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93730) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:37:54 devstack cinder-volume[93730]: DEBUG oslo_concurrency.processutils [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=93730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:37:54 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:37:54 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:37:54 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Aug 27 03:37:54 devstack cinder-volume[93730]: DEBUG oslo_concurrency.processutils [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.255s {{(pid=93730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:37:54 devstack cinder-volume[93730]: INFO cinder.volume.manager [None req-09d1a92d-988a-4146-bdca-cf2410bb5768 None None] Driver post RPC initialization completed successfully. Aug 27 03:37:59 devstack cinder-volume[93730]: DEBUG oslo_concurrency.lockutils [None req-3069c3fa-7a09-4e8e-9546-33c79b668370 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93730) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:37:59 devstack cinder-volume[93730]: DEBUG oslo_concurrency.lockutils [None req-3069c3fa-7a09-4e8e-9546-33c79b668370 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93730) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:37:59 devstack cinder-volume[93730]: DEBUG cinder.volume.drivers.quobyte [None req-3069c3fa-7a09-4e8e-9546-33c79b668370 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=93730) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:37:59 devstack cinder-volume[93730]: DEBUG cinder.volume.drivers.quobyte [None req-3069c3fa-7a09-4e8e-9546-33c79b668370 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=93730) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:37:59 devstack cinder-volume[93730]: DEBUG oslo_concurrency.lockutils [None req-3069c3fa-7a09-4e8e-9546-33c79b668370 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93730) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:37:59 devstack cinder-volume[93730]: DEBUG oslo_concurrency.processutils [None req-3069c3fa-7a09-4e8e-9546-33c79b668370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=93730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:37:59 devstack sudo[93930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:37:59 devstack sudo[93930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:37:59 devstack sudo[93930]: pam_unix(sudo:session): session closed for user root Aug 27 03:37:59 devstack cinder-volume[93730]: DEBUG oslo_concurrency.processutils [None req-3069c3fa-7a09-4e8e-9546-33c79b668370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.226s {{(pid=93730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:37:59 devstack cinder-volume[93730]: DEBUG cinder.manager [None req-3069c3fa-7a09-4e8e-9546-33c79b668370 None None] Notifying Schedulers of capabilities ... {{(pid=93730) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:38:00 devstack cinder-volume[93513]: INFO oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Caught SIGTERM, stopping children Aug 27 03:38:00 devstack cinder-volume[93513]: DEBUG oslo_concurrency.lockutils [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Acquiring lock "singleton_lock" {{(pid=93513) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 27 03:38:00 devstack cinder-volume[93513]: DEBUG oslo_concurrency.lockutils [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Acquired lock "singleton_lock" {{(pid=93513) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 27 03:38:00 devstack cinder-volume[93513]: DEBUG oslo_concurrency.lockutils [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Releasing lock "singleton_lock" {{(pid=93513) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 27 03:38:00 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Stop services. {{(pid=93513) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 27 03:38:00 devstack cinder-volume[93513]: DEBUG oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Killing children. {{(pid=93513) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 27 03:38:00 devstack cinder-volume[93513]: INFO oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Waiting on 1 children to exit Aug 27 03:38:02 devstack cinder-volume[93730]: DEBUG oslo_concurrency.lockutils [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Acquiring lock "singleton_lock" {{(pid=93730) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 27 03:38:02 devstack cinder-volume[93730]: DEBUG oslo_concurrency.lockutils [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Acquired lock "singleton_lock" {{(pid=93730) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 27 03:38:02 devstack cinder-volume[93730]: DEBUG oslo_concurrency.lockutils [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Releasing lock "singleton_lock" {{(pid=93730) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 27 03:38:02 devstack cinder-volume[93730]: WARNING amqp [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 27 03:38:02 devstack cinder-volume[93730]: WARNING amqp [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 27 03:38:02 devstack cinder-volume[93513]: INFO oslo_service.backend._eventlet.service [None req-d4acb0fc-41bb-42d9-968b-4f95e07ff632 None None] Child 93730 exited with status 0 Aug 27 03:38:03 devstack cinder-volume[94049]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 27 03:38:03 devstack cinder-volume[94049]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 27 03:38:03 devstack cinder-volume[94049]: we strongly recommend against using it for new projects. Aug 27 03:38:03 devstack cinder-volume[94049]: If you are already using Eventlet, we recommend migrating to a different Aug 27 03:38:03 devstack cinder-volume[94049]: framework. For more detail see Aug 27 03:38:03 devstack cinder-volume[94049]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 27 03:38:03 devstack cinder-volume[94049]: import eventlet # noqa Aug 27 03:38:05 devstack cinder-volume[94049]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=94049) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 27 03:38:05 devstack cinder-volume[94049]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=94049) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 27 03:38:05 devstack cinder-volume[94049]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=94049) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 27 03:38:06 devstack cinder-volume[94049]: INFO dbcounter [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] Registered counter for database cinder Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_db.sqlalchemy.engines [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94049) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG dbcounter [-] [94049] Writer thread running {{(pid=94049) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 27 03:38:07 devstack cinder-volume[94049]: INFO cinder.rpc [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 27 03:38:07 devstack cinder-volume[94049]: INFO cinder.rpc [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_db.sqlalchemy.engines [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94049) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 27 03:38:07 devstack cinder-volume[94049]: INFO cinder.volume.manager [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] Determined volume DB was empty at startup. Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG cinder.volume.manager [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=94049) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 27 03:38:07 devstack cinder-volume[94049]: WARNING stevedore.named [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 27 03:38:07 devstack cinder-volume[94049]: WARNING castellan.key_manager [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 27 03:38:07 devstack cinder-volume[94049]: WARNING cinder.keymgr.conf_key_mgr [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 27 03:38:07 devstack cinder-volume[94049]: INFO cinder.volume.manager [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_db.sqlalchemy.engines [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94049) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 27 03:38:07 devstack cinder-volume[94049]: INFO oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] Starting 1 workers Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] Started child 94328 {{(pid=94049) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] Full set of CONF: {{(pid=94049) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] ******************************************************************************** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] Configuration options gathered from: {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] ================================================================================ {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] allow_availability_zone_fallback = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] allow_compression_on_image_upload = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] allowed_direct_url_schemes = [] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] api_rate_limit = True {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] auth_strategy = keystone {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_availability_zone = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_host = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_name = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94328]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_stats_polling_interval = 60 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backup_api_class = cinder.backup.api.API {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backup_name_template = backup-%s {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backup_use_same_host = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backup_use_temp_snapshot = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] chap_password = **** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] chap_username = {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cinder_internal_tenant_project_id = 2c47caf6b1704dd88ff2459e0c226eb0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cinder_internal_tenant_user_id = a19ddda3472e43249a8e432f5a87e055 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cluster = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] compression_format = gzip {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] compute_api_class = cinder.compute.nova.API {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] config_dir = [] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] config_source = [] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] control_exchange = openstack {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] debug = True {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] default_availability_zone = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] default_group_type = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] default_volume_type = QuobyteHD {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] disk_geometry = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] driver_client_cert = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] driver_client_cert_key = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] driver_data_namespace = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] driver_ssl_cert_path = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] driver_ssl_cert_verify = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] driver_use_ssl = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] enable_new_services = True {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] enable_unsupported_driver = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] enabled_backends = ['QuobyteHD'] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] enforce_multipath_for_image_xfer = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] filter_function = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] glance_api_insecure = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] glance_api_servers = ['http://192.168.122.216/image'] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] glance_api_ssl_compression = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] glance_ca_certificates_file = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] glance_catalog_info = image:glance:publicURL {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] glance_certfile = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] glance_keyfile = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] glance_num_retries = 3 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] glance_request_timeout = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] goodness_function = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] graceful_shutdown_timeout = 5 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] group_api_class = cinder.group.api.API {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] host = devstack {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] image_compress_on_upload = True {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] image_conversion_address_space_limit = 1 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] image_conversion_cpu_limit = 60 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Starting volume driver QuobyteDriver (1.2.1) Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=94328) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] image_conversion_disable = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] image_upload_use_cinder_backend = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] image_upload_use_internal_tenant = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] image_volume_cache_enabled = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] image_volume_cache_max_count = 0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] image_volume_cache_max_size_gb = 0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] init_host_max_objects_retrieval = 0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] instance_format = [instance: %(uuid)s] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] iscsi_target_flags = {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] iscsi_write_cache = on {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] iser_helper = tgtadm {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] iser_ip_address = 192.168.122.216 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] iser_port = 3260 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] log_color = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] log_config_append = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] log_dir = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] log_file = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] log_options = True {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] log_rotate_interval = 1 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] log_rotate_interval_type = days {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] log_rotation_type = none {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] max_age = 0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] max_logfile_count = 30 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] max_logfile_size_mb = 200 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] max_over_subscription_ratio = 20.0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] message_reap_interval = 86400 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] message_ttl = 2592000 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] migration_create_volume_timeout_secs = 300 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] monkey_patch = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] monkey_patch_modules = [] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] my_ip = 192.168.122.216 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:07 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] no_snapshot_gb_quota = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] num_iser_scan_tries = 3 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] num_shell_tries = 3 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] num_volume_device_scan_tries = 3 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] nvmeof_conn_info_version = 1 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] nvmet_ns_id = 10 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] nvmet_port_id = 1 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] osapi_max_limit = 1000 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] osapi_volume_ext_list = [] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] osapi_volume_listen_port = 8776 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] osapi_volume_use_ssl = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] osapi_volume_workers = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] per_volume_size_limit = -1 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] periodic_fuzzy_delay = 60 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] periodic_interval = 60 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] public_endpoint = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] publish_errors = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] quota_backup_gigabytes = 1000 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] quota_backups = 10 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] quota_gigabytes = 1000 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] quota_groups = 10 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] quota_snapshots = 10 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] quota_volumes = 10 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] rate_limit_burst = 0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] rate_limit_except_level = CRITICAL {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] rate_limit_interval = 0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] reinit_driver_count = 3 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] replication_device = **** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] report_discard_supported = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] report_interval = 120 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] reservation_clean_interval = 86400 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] reservation_expire = 86400 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] reserved_image_namespaces = [] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] reserved_percentage = 0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] rpc_response_timeout = 120 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] run_external_periodic_tasks = True {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] scst_target_driver = iscsi {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] scst_target_iqn_name = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] service_down_time = 720 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] shell_completion = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] snapshot_name_template = snapshot-%s {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] split_loggers = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] state_path = /opt/stack/data/cinder {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] storage_availability_zone = nova {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] storage_protocol = iSCSI {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] syslog_log_facility = LOG_USER {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] target_helper = lioadm {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] target_ip_address = 192.168.122.216 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] target_port = 3260 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] target_protocol = iscsi {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] target_secondary_ip_addresses = [] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] trace_flags = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] transport_url = **** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] until_refresh = 0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] use_chap_auth = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] use_default_quota_class = True {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] use_journal = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] use_json = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] use_multipath_for_image_xfer = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] use_stderr = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] use_syslog = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] verify_glance_signatures = enabled {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] volume_api_class = cinder.volume.api.API {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] volume_backend_name = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] volume_clear = zero {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] volume_clear_ionice = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] volume_clear_size = 0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] volume_copy_bps_limit = 0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] volume_dd_blocksize = 1M {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] volume_name_template = volume-%s {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] volume_service_inithost_offload = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] volume_usage_audit_period = month {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] zoning_mode = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 27 03:38:08 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=94328) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 27 03:38:08 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.quobyte [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_concurrency.disable_process_locking = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.quobyte [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 27 03:38:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Running cmd (subprocess): mount.quobyte {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.auth_section = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.auth_type = password {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.auth_version = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.cache = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.certfile = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.include_service_catalog = True {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.insecure = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.interface = public {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.keyfile = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.memcache_password = **** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.memcache_username = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.region_name = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.service_type = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.216/identity {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.backend = dogpile.cache.null {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.backend_argument = **** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.backend_expiration_time = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.config_prefix = cache.oslo {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.debug_cache_backend = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.enable_retry_client = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.enable_socket_keepalive = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.enabled = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.expiration_time = 600 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.hashclient_retry_attempts = 2 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.memcache_dead_retry = 300 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.memcache_pool_maxsize = 10 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.memcache_sasl_enabled = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.password = **** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.proxies = [] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.redis_db = 0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.redis_server = localhost:6379 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.retry_attempts = 2 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.retry_delay = 0.0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.socket_keepalive_count = 1 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.socket_keepalive_idle = 1 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack quobyte-client[94329]: Reading configuration file: /etc/quobyte/client.cfg Aug 27 03:38:08 devstack quobyte-client[94329]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.socket_keepalive_interval = 1 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.socket_timeout = 1.0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.tls_allowed_ciphers = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.tls_cafile = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.tls_certfile = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.tls_enabled = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.tls_keyfile = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cache.username = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] coordination.backend_url = **** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] database.asyncio_connection = **** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] CMD "mount.quobyte" returned: 1 in 0.057s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] database.asyncio_slave_connection = **** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] database.backend = sqlalchemy {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] database.connection = **** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] database.connection_debug = 0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] database.connection_parameters = {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] database.connection_recycle_time = 3600 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] database.connection_trace = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] database.db_inc_retry_interval = True {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] database.db_max_retries = 20 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] database.db_max_retry_interval = 10 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] database.db_retry_interval = 1 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] database.max_overflow = 50 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] database.max_pool_size = 5 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] database.max_retries = 10 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] database.mysql_wsrep_sync_wait = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] database.pool_timeout = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] database.retry_interval = 10 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] database.slave_connection = **** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:38:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:38:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] database.sqlite_synchronous = True {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] database.synchronous_reader = True {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] database.use_db_reconnect = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] profiler.connection_string = messaging:// {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] profiler.enabled = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] profiler.es_doc_type = notification {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] profiler.es_scroll_size = 10000 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] profiler.es_scroll_time = 2m {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] profiler.filter_error_trace = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] profiler.hmac_keys = **** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] profiler.sentinel_service_name = mymaster {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] profiler.socket_timeout = 0.1 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] profiler.trace_requests = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] profiler.trace_sqlalchemy = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] profiler_jaeger.process_tags = {} {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] profiler_jaeger.service_name_prefix = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] profiler_otlp.service_name_prefix = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_policy.enforce_new_defaults = True {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_policy.policy_default_rule = default {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_policy.policy_file = policy.yaml {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] privsep_osbrick.group = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] privsep_osbrick.helper_command = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] privsep_osbrick.user = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cinder_sys_admin.group = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cinder_sys_admin.helper_command = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] cinder_sys_admin.user = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] service_user.auth_section = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] service_user.auth_type = password {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] service_user.cafile = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] service_user.certfile = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] service_user.collect_timing = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] service_user.insecure = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] service_user.keyfile = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] service_user.send_service_user_token = True {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] service_user.split_loggers = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] service_user.timeout = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] glance.auth_section = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] glance.auth_type = password {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] glance.certfile = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] glance.collect_timing = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] glance.insecure = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] glance.keyfile = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] glance.region_name = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] glance.split_loggers = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] glance.timeout = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.backend_availability_zone = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.chap_password = **** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.chap_username = {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.disk_geometry = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.driver_client_cert = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.driver_client_cert_key = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.driver_data_namespace = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.driver_use_ssl = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.extra_capabilities = {} {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.filter_function = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.goodness_function = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.iscsi_target_flags = {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.iscsi_write_cache = on {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.iser_helper = tgtadm {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.iser_ip_address = 192.168.122.216 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.iser_port = 3260 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.nas_host = {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.nas_login = admin {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.nas_mount_options = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.nas_password = **** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.nas_private_key = {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.nas_share_path = {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.nas_ssh_port = 22 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.num_shell_tries = 3 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.quobyte_volume_url = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.replication_device = **** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.report_discard_supported = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.reserved_percentage = 0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.target_helper = tgtadm {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.target_ip_address = 192.168.122.216 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.target_port = 3260 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.target_protocol = iscsi {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.trace_flags = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.unique_fqdn_network = True {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.use_chap_auth = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.volume_backend_name = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.volume_clear = zero {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.volume_clear_ionice = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.volume_clear_size = 0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_reports.file_event_handler = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_reports.log_dir = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.backend_availability_zone = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.backend_host = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.chap_password = **** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.chap_username = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.chiscsi_conf = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.disk_geometry = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.driver_client_cert = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.driver_data_namespace = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.driver_use_ssl = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.extra_capabilities = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.filter_function = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.goodness_function = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.iscsi_target_flags = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.iscsi_write_cache = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.iser_helper = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.iser_ip_address = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.iser_port = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.iser_target_prefix = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.nas_host = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.nas_login = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.nas_mount_options = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.nas_password = **** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.nas_private_key = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.nas_share_path = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.nas_ssh_port = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.num_shell_tries = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.nvmet_ns_id = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.nvmet_port_id = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.replication_device = **** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.report_discard_supported = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.reserved_percentage = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.scst_target_driver = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.storage_protocol = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.target_helper = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.target_ip_address = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.target_port = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.target_prefix = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.target_protocol = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.trace_flags = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.unique_fqdn_network = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.use_chap_auth = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.volume_clear = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.volume_clear_ionice = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.volume_clear_size = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] QuobyteHD.volumes_dir = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.ssl = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_notifications.driver = [] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_notifications.retry = -1 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] key_manager.fixed_key = **** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican.barbican_api_version = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican.barbican_endpoint = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican.barbican_endpoint_type = public {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican.barbican_region_name = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican.cafile = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican.certfile = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican.collect_timing = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican.insecure = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican.keyfile = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican.number_of_retries = 60 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican.retry_delay = 1 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican.send_service_user_token = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican.split_loggers = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican.timeout = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican.verify_ssl = True {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican.verify_ssl_path = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican_service_user.auth_section = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican_service_user.auth_type = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican_service_user.cafile = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican_service_user.certfile = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican_service_user.collect_timing = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican_service_user.insecure = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican_service_user.keyfile = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican_service_user.split_loggers = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] barbican_service_user.timeout = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] vault.approle_role_id = **** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] vault.approle_secret_id = **** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] vault.auth_method = approle {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] vault.auth_path = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] vault.kv_mountpoint = secret {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] vault.kv_path = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] vault.kv_version = 2 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] vault.namespace = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] vault.root_token_id = **** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] vault.ssl_ca_crt_file = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] vault.timeout = 60.0 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] vault.token_file = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] vault.token_role = None {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] vault.use_ssl = False {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 27 03:38:08 devstack cinder-volume[94049]: DEBUG oslo_service.backend._eventlet.service [None req-1b012d4a-83ba-405e-8a39-879b4b6007d0 None None] ******************************************************************************** {{(pid=94049) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 27 03:38:08 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Aug 27 03:38:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.744s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:38:08 devstack cinder-volume[94328]: INFO cinder.volume.driver [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Driver hasn't implemented _init_vendor_properties() Aug 27 03:38:08 devstack cinder-volume[94328]: DEBUG cinder.volume.driver [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.739345550537, 'free_capacity_gb': 1774.739345550537, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94328) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 27 03:38:09 devstack cinder-volume[94328]: DEBUG oslo_db.sqlalchemy.engines [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94328) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 27 03:38:09 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writer thread running {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 27 03:38:09 devstack cinder-volume[94328]: DEBUG cinder.db.api [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Building query based on filter {{(pid=94328) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 27 03:38:09 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=94328) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 27 03:38:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:38:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:38:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:38:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:38:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:38:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:38:09 devstack cinder-volume[94328]: INFO cinder.keymgr.migration [None req-9f311f5d-b09c-49ee-86ae-2911da4739e6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 27 03:38:09 devstack sudo[94346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:38:09 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:38:09 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root Aug 27 03:38:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.273s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:38:09 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:38:09 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Driver initialization completed successfully. Aug 27 03:38:09 devstack cinder-volume[94328]: INFO cinder.manager [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Initiating service 3 cleanup Aug 27 03:38:09 devstack cinder-volume[94328]: INFO cinder.manager [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Service 3 cleanup completed. Aug 27 03:38:09 devstack cinder-volume[94328]: DEBUG cinder.service [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Creating RPC server for service cinder-volume {{(pid=94328) start /opt/stack/cinder/cinder/service.py:231}} Aug 27 03:38:09 devstack cinder-volume[94328]: DEBUG cinder.service [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=94328) start /opt/stack/cinder/cinder/service.py:237}} Aug 27 03:38:09 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 27 03:38:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:38:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:38:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:38:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:38:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:38:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:38:09 devstack sudo[94357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:38:09 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:38:09 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root Aug 27 03:38:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.247s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:38:09 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-3579b0f9-ca17-4738-b8e0-60f295542b30 None None] Driver post RPC initialization completed successfully. Aug 27 03:38:14 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager._thread_info {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:38:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread count: 6 {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 03:38:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread info: [<_MainThread(MainThread, started 134250325188736)>, , , , , ] {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 03:38:17 devstack cinder-volume[94049]: DEBUG dbcounter [-] [94049] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=94049) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:38:19 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=2 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:38:19 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:39:14 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:39:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:39:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:39:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:39:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:39:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:39:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:39:14 devstack sudo[95010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:39:14 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:39:15 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root Aug 27 03:39:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.482s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:39:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:39:15 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager._thread_info {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:39:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread count: 6 {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 03:39:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread info: [<_MainThread(MainThread, started 134250325188736)>, , , , , ] {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 03:39:21 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:39:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Flow 'volume_create_manager' (f59fb29a-b80a-49a4-8f15-86a0344c55ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:39:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff90c324-1731-4d53-b8e7-6e6ca9105e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:39:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff90c324-1731-4d53-b8e7-6e6ca9105e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2081366387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='706f0a00cba94c558016d61f02df4806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:39:21Z,use_quota=True,user_id='f0f670d049e84674a442d6e631e3ee15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:39:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3ca3e2-faa7-4160-ac4a-dc6db8bc64ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:39:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3ca3e2-faa7-4160-ac4a-dc6db8bc64ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:39:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf23d67-955f-47cb-90bd-fc781465eea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:39:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf23d67-955f-47cb-90bd-fc781465eea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d', 'volume_name': 'volume-3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:39:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd744ea-af60-4ed0-9a24-35e527adf71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:39:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd744ea-af60-4ed0-9a24-35e527adf71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:39:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b954c6b-4a46-40a8-ad25-5f8ba0f76276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:39:22 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Volume 3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d', 'volume_size': 1} Aug 27 03:39:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:39:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:39:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2081366387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='706f0a00cba94c558016d61f02df4806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:39:21Z,use_quota=True,user_id='f0f670d049e84674a442d6e631e3ee15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:39:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Creating volume 3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:39:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:39:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:39:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:39:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:39:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:39:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:39:22 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:39:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:39:22 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d 1073741824 Aug 27 03:39:22 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:39:23 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Aug 27 03:39:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d 1073741824" returned: 0 in 1.622s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:39:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:39:23 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d Aug 27 03:39:23 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:39:24 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Aug 27 03:39:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d" returned: 0 in 0.404s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:39:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] <== create_volume: return (2170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:39:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.177s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:39:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b954c6b-4a46-40a8-ad25-5f8ba0f76276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:39:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490b9d51-0642-4c15-8118-9ce200960688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:39:24 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Volume volume-3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d (3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d): created successfully Aug 27 03:39:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490b9d51-0642-4c15-8118-9ce200960688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:39:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Flow 'volume_create_manager' (f59fb29a-b80a-49a4-8f15-86a0344c55ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:39:24 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-8a08cc6c-dce5-4abf-94ad-c5e920dab086 tempest-DeleteServersTestJSON-151554676 None] Created volume successfully. Aug 27 03:39:26 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:39:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Flow 'volume_create_manager' (fc2d4432-2b6b-4a96-8c1c-70746ff8dddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:39:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555e34f0-a5fc-455e-a565-2c6619972855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:39:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555e34f0-a5fc-455e-a565-2c6619972855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-542719957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbe8877e-e279-41de-9d00-d3e72fd2bd6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62fb9e66f74540d49b9f541122ec1312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:39:26Z,use_quota=True,user_id='c917dec102044388a2164533bd658244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:39:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233787a8-9c60-4331-a26e-f49dcc3aff9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:39:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233787a8-9c60-4331-a26e-f49dcc3aff9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:39:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d50bb0d-6f6f-4fb2-98fb-e0ccb2d4c505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:39:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d50bb0d-6f6f-4fb2-98fb-e0ccb2d4c505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbe8877e-e279-41de-9d00-d3e72fd2bd6f', 'volume_name': 'volume-cbe8877e-e279-41de-9d00-d3e72fd2bd6f', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:39:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b824671-888f-402a-b32b-2b2e81e54610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:39:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b824671-888f-402a-b32b-2b2e81e54610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:39:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d48940-8cc5-4a6a-950e-fa749bd179a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:39:26 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Volume cbe8877e-e279-41de-9d00-d3e72fd2bd6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbe8877e-e279-41de-9d00-d3e72fd2bd6f', 'volume_size': 1} Aug 27 03:39:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:39:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:39:26 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-542719957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbe8877e-e279-41de-9d00-d3e72fd2bd6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62fb9e66f74540d49b9f541122ec1312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:39:26Z,use_quota=True,user_id='c917dec102044388a2164533bd658244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:39:26 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Creating volume cbe8877e-e279-41de-9d00-d3e72fd2bd6f {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:39:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:39:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:39:26 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:39:26 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:39:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:39:26 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:39:26 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:39:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-cbe8877e-e279-41de-9d00-d3e72fd2bd6f 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:39:26 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-cbe8877e-e279-41de-9d00-d3e72fd2bd6f 1073741824 Aug 27 03:39:26 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:39:27 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Aug 27 03:39:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-cbe8877e-e279-41de-9d00-d3e72fd2bd6f 1073741824" returned: 0 in 1.061s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:39:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-cbe8877e-e279-41de-9d00-d3e72fd2bd6f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:39:27 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-cbe8877e-e279-41de-9d00-d3e72fd2bd6f Aug 27 03:39:27 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:39:28 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Aug 27 03:39:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-cbe8877e-e279-41de-9d00-d3e72fd2bd6f" returned: 0 in 0.785s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:39:28 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] <== create_volume: return (1959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:39:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:39:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d48940-8cc5-4a6a-950e-fa749bd179a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbe8877e-e279-41de-9d00-d3e72fd2bd6f', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:39:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b506e427-09c8-4b3d-9255-65d55ceb308c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:39:28 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Volume volume-cbe8877e-e279-41de-9d00-d3e72fd2bd6f (cbe8877e-e279-41de-9d00-d3e72fd2bd6f): created successfully Aug 27 03:39:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b506e427-09c8-4b3d-9255-65d55ceb308c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:39:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Flow 'volume_create_manager' (fc2d4432-2b6b-4a96-8c1c-70746ff8dddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:39:28 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d92226f5-c0ab-45cf-9c64-bac1cf1c7d8c tempest-VolumesAdminNegativeTest-839771738 None] Created volume successfully. Aug 27 03:39:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] Acquiring lock "cinder-cbe8877e-e279-41de-9d00-d3e72fd2bd6f-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:39:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] Lock "cinder-cbe8877e-e279-41de-9d00-d3e72fd2bd6f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:39:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] Acquiring lock "cinder-quobyte-cbe8877e-e279-41de-9d00-d3e72fd2bd6f" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:39:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] Lock "cinder-quobyte-cbe8877e-e279-41de-9d00-d3e72fd2bd6f" acquired by "delete_volume" :: waited 0.065s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:39:30 devstack cinder-volume[94328]: INFO oslo.privsep.daemon [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpedsg6yx4/privsep.sock'] Aug 27 03:39:30 devstack sudo[95535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpedsg6yx4/privsep.sock Aug 27 03:39:30 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:39:31 devstack cinder-volume[94328]: WARNING py.warnings [req-8dd467e5-eb9e-4b10-a941-123cdfb0b462 req-7ef9f927-fe1c-46c4-af2e-f934aa055047 tempest-DeleteServersTestJSON-151554676 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Aug 27 03:39:31 devstack cinder-volume[94328]: .first() Aug 27 03:39:31 devstack cinder-volume[94328]: Aug 27 03:39:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-8dd467e5-eb9e-4b10-a941-123cdfb0b462 req-7ef9f927-fe1c-46c4-af2e-f934aa055047 tempest-DeleteServersTestJSON-151554676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:39:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-8dd467e5-eb9e-4b10-a941-123cdfb0b462 req-7ef9f927-fe1c-46c4-af2e-f934aa055047 tempest-DeleteServersTestJSON-151554676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:39:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-8dd467e5-eb9e-4b10-a941-123cdfb0b462 req-7ef9f927-fe1c-46c4-af2e-f934aa055047 tempest-DeleteServersTestJSON-151554676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:39:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-8dd467e5-eb9e-4b10-a941-123cdfb0b462 req-7ef9f927-fe1c-46c4-af2e-f934aa055047 tempest-DeleteServersTestJSON-151554676 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac', 'name': 'volume-3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f34f058f-81df-423f-8b10-45be4cc691c2', 'enforce_multipath': True} {{(pid=94328) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 27 03:39:32 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-8dd467e5-eb9e-4b10-a941-123cdfb0b462 req-7ef9f927-fe1c-46c4-af2e-f934aa055047 tempest-DeleteServersTestJSON-151554676 None] attachment_update completed successfully. Aug 27 03:39:33 devstack cinder-volume[94328]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 27 03:39:33 devstack cinder-volume[94328]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 27 03:39:33 devstack cinder-volume[94328]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 27 03:39:33 devstack cinder-volume[94328]: WARNING oslo.privsep.daemon [-] privsep log: Aug 27 03:39:33 devstack cinder-volume[94328]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 27 03:39:33 devstack cinder-volume[94328]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 27 03:39:33 devstack cinder-volume[94328]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 27 03:39:33 devstack cinder-volume[94328]: WARNING oslo.privsep.daemon [-] privsep log: Aug 27 03:39:33 devstack cinder-volume[94328]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 27 03:39:33 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root Aug 27 03:39:33 devstack cinder-volume[94328]: INFO oslo.privsep.daemon [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] Spawned new privsep daemon via rootwrap Aug 27 03:39:33 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] Accepted privsep connection to /tmp/tmpedsg6yx4/privsep.sock {{(pid=94328) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 27 03:39:33 devstack cinder-volume[94328]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 27 03:39:33 devstack cinder-volume[94328]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 27 03:39:33 devstack cinder-volume[94328]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 27 03:39:33 devstack cinder-volume[94328]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95576 Aug 27 03:39:33 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7709c7-daef-475d-a926-35dd1a25f137]: (2,) {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:39:33 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[0019da7c-ad93-46b2-aa98-1b4bf7388d55]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:39:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-cbe8877e-e279-41de-9d00-d3e72fd2bd6f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:39:34 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-cbe8877e-e279-41de-9d00-d3e72fd2bd6f Aug 27 03:39:34 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:39:34 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Aug 27 03:39:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-cbe8877e-e279-41de-9d00-d3e72fd2bd6f" returned: 0 in 1.133s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:39:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-cbe8877e-e279-41de-9d00-d3e72fd2bd6f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:39:34 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-cbe8877e-e279-41de-9d00-d3e72fd2bd6f Aug 27 03:39:34 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:39:35 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Aug 27 03:39:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-cbe8877e-e279-41de-9d00-d3e72fd2bd6f" returned: 0 in 0.357s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:39:35 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] Lock "cinder-quobyte-cbe8877e-e279-41de-9d00-d3e72fd2bd6f" released by "delete_volume" :: held 4.339s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:39:35 devstack cinder-volume[94328]: WARNING cinder.quota [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:39:35 devstack cinder-volume[94328]: WARNING cinder.quota [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:39:35 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] Created reservations ['f80c0cd5-8fc8-49ea-a50b-df9cf2bb3ca1', 'b8330349-ae04-4f8b-88d3-8ee16e629749', '2193556c-7aed-40c6-a762-b13e9190fc09', 'a8acd9eb-d6bb-490e-9af0-97a9c46a171b'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:39:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:39:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:39:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:39:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:39:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:39:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:39:35 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:39:35 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:39:36 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Aug 27 03:39:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.516s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:39:36 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:39:36 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] Deleted volume successfully. Aug 27 03:39:36 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-db4220a7-6406-4222-a45d-1feb137939e5 tempest-VolumesAdminNegativeTest-839771738 None] Lock "cinder-cbe8877e-e279-41de-9d00-d3e72fd2bd6f-delete_volume" released by "delete_volume" :: held 5.517s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:39:39 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-0e6d1e9d-2647-4e0e-bd5a-9b5a5d894f7d req-74a7055a-0bec-44e7-89dc-40dc266b57af tempest-DeleteServersTestJSON-151554676 None] Terminate volume connection completed successfully. Aug 27 03:39:39 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-0e6d1e9d-2647-4e0e-bd5a-9b5a5d894f7d req-74a7055a-0bec-44e7-89dc-40dc266b57af tempest-DeleteServersTestJSON-151554676 None] Deleting attachment f34f058f-81df-423f-8b10-45be4cc691c2. {{(pid=94328) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 27 03:39:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-69a1f74e-5717-41f9-84bc-4af82982372a tempest-DeleteServersTestJSON-151554676 None] Acquiring lock "cinder-3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:39:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-69a1f74e-5717-41f9-84bc-4af82982372a tempest-DeleteServersTestJSON-151554676 None] Lock "cinder-3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:39:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-69a1f74e-5717-41f9-84bc-4af82982372a tempest-DeleteServersTestJSON-151554676 None] Acquiring lock "cinder-quobyte-3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:39:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-69a1f74e-5717-41f9-84bc-4af82982372a tempest-DeleteServersTestJSON-151554676 None] Lock "cinder-quobyte-3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d" acquired by "delete_volume" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:39:41 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44998a5-198e-41b4-90d9-aabfc9b415e8]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:39:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-69a1f74e-5717-41f9-84bc-4af82982372a tempest-DeleteServersTestJSON-151554676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:39:41 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d Aug 27 03:39:41 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:39:41 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Aug 27 03:39:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-69a1f74e-5717-41f9-84bc-4af82982372a tempest-DeleteServersTestJSON-151554676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d" returned: 0 in 0.572s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:39:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-69a1f74e-5717-41f9-84bc-4af82982372a tempest-DeleteServersTestJSON-151554676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:39:41 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d Aug 27 03:39:41 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:39:42 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Aug 27 03:39:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-69a1f74e-5717-41f9-84bc-4af82982372a tempest-DeleteServersTestJSON-151554676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d" returned: 0 in 0.346s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:39:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-69a1f74e-5717-41f9-84bc-4af82982372a tempest-DeleteServersTestJSON-151554676 None] Lock "cinder-quobyte-3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d" released by "delete_volume" :: held 0.963s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:39:42 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-69a1f74e-5717-41f9-84bc-4af82982372a tempest-DeleteServersTestJSON-151554676 None] Created reservations ['caef87f0-a018-4e34-bf9a-51405149b75b', 'fa38ff5b-78e1-4a98-8bed-fb787ae84122', 'aebba680-ecbd-41c0-8a20-9bf524a03756', '9928274b-532f-4ea4-831e-95b133f1f8b5'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:39:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-69a1f74e-5717-41f9-84bc-4af82982372a tempest-DeleteServersTestJSON-151554676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:39:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-69a1f74e-5717-41f9-84bc-4af82982372a tempest-DeleteServersTestJSON-151554676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:39:42 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-69a1f74e-5717-41f9-84bc-4af82982372a tempest-DeleteServersTestJSON-151554676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:39:42 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-69a1f74e-5717-41f9-84bc-4af82982372a tempest-DeleteServersTestJSON-151554676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:39:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-69a1f74e-5717-41f9-84bc-4af82982372a tempest-DeleteServersTestJSON-151554676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:39:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-69a1f74e-5717-41f9-84bc-4af82982372a tempest-DeleteServersTestJSON-151554676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:39:42 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:39:42 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:39:42 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Aug 27 03:39:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-69a1f74e-5717-41f9-84bc-4af82982372a tempest-DeleteServersTestJSON-151554676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.412s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:39:42 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-69a1f74e-5717-41f9-84bc-4af82982372a tempest-DeleteServersTestJSON-151554676 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:39:42 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-69a1f74e-5717-41f9-84bc-4af82982372a tempest-DeleteServersTestJSON-151554676 None] Deleted volume successfully. Aug 27 03:39:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-69a1f74e-5717-41f9-84bc-4af82982372a tempest-DeleteServersTestJSON-151554676 None] Lock "cinder-3c8fe7fa-b908-4d5d-95c7-a3e427fbcd9d-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:39:52 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=24,cinder:UPDATE=22,cinder:INSERT=6 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:39:52 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=19,cinder:UPDATE=25,cinder:DELETE=4,cinder:INSERT=4 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:39:57 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:39:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Flow 'volume_create_manager' (0c71c0ee-fd15-406a-8d87-4c0368bea619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:39:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4970b17b-2216-4b95-b735-ba109edfe4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:39:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4970b17b-2216-4b95-b735-ba109edfe4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-573934002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc948c6-0ef8-4a53-866c-50f13f3eeeb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c488ec61452942209fda2b69875fb435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:39:58Z,use_quota=True,user_id='d7d847d79e974c61a30af5c0f5f01dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:39:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a321bab-9286-4c5c-88df-96044eb43429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:39:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a321bab-9286-4c5c-88df-96044eb43429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:39:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a0ec07-54c4-4341-936f-d5fc167b3328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:39:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a0ec07-54c4-4341-936f-d5fc167b3328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bc948c6-0ef8-4a53-866c-50f13f3eeeb4', 'volume_name': 'volume-2bc948c6-0ef8-4a53-866c-50f13f3eeeb4', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:39:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c9d5f6-9d9b-4af9-9d4c-bf74e6de4c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:39:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c9d5f6-9d9b-4af9-9d4c-bf74e6de4c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:39:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3d9b43e-bf68-4ed7-8f3b-20b5bde100f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:39:57 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Volume 2bc948c6-0ef8-4a53-866c-50f13f3eeeb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bc948c6-0ef8-4a53-866c-50f13f3eeeb4', 'volume_size': 1} Aug 27 03:39:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:39:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:39:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-573934002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc948c6-0ef8-4a53-866c-50f13f3eeeb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c488ec61452942209fda2b69875fb435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:39:58Z,use_quota=True,user_id='d7d847d79e974c61a30af5c0f5f01dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:39:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Creating volume 2bc948c6-0ef8-4a53-866c-50f13f3eeeb4 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:39:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:39:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:39:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:39:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:39:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:39:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:39:57 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:39:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2bc948c6-0ef8-4a53-866c-50f13f3eeeb4 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:39:57 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2bc948c6-0ef8-4a53-866c-50f13f3eeeb4 1073741824 Aug 27 03:39:57 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:39:58 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Aug 27 03:39:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2bc948c6-0ef8-4a53-866c-50f13f3eeeb4 1073741824" returned: 0 in 0.512s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:39:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2bc948c6-0ef8-4a53-866c-50f13f3eeeb4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:39:58 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2bc948c6-0ef8-4a53-866c-50f13f3eeeb4 Aug 27 03:39:58 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:39:58 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Aug 27 03:39:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2bc948c6-0ef8-4a53-866c-50f13f3eeeb4" returned: 0 in 0.324s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:39:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:39:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:39:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3d9b43e-bf68-4ed7-8f3b-20b5bde100f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bc948c6-0ef8-4a53-866c-50f13f3eeeb4', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:39:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6900c53d-5f53-438e-8425-32ee0ee2cc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:39:58 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Volume volume-2bc948c6-0ef8-4a53-866c-50f13f3eeeb4 (2bc948c6-0ef8-4a53-866c-50f13f3eeeb4): created successfully Aug 27 03:39:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6900c53d-5f53-438e-8425-32ee0ee2cc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:39:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Flow 'volume_create_manager' (0c71c0ee-fd15-406a-8d87-4c0368bea619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:39:58 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-ebbfab97-0c49-4a07-bfee-d97ef314ae5d tempest-AttachVolumeTestJSON-1763649932 None] Created volume successfully. Aug 27 03:39:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8d4a7dd5-c779-4ff1-ae8a-a77f66d3b983 tempest-BackendsCapabilitiesAdminTestsJSON-1542413999 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.739345550537, 'free_capacity_gb': 1774.739345550537, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94328) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 27 03:39:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8bf95d15-dbab-469c-af89-7dc4cb02c56a tempest-BackendsCapabilitiesAdminTestsJSON-1542413999 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.739345550537, 'free_capacity_gb': 1774.739345550537, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94328) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 27 03:40:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-85ae129a-6302-4e27-a1a4-cad5b0dc6423 req-5b2add9e-dfdb-4fb1-a273-146a17b1c4cf tempest-AttachVolumeTestJSON-1763649932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:40:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-85ae129a-6302-4e27-a1a4-cad5b0dc6423 req-5b2add9e-dfdb-4fb1-a273-146a17b1c4cf tempest-AttachVolumeTestJSON-1763649932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:40:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-85ae129a-6302-4e27-a1a4-cad5b0dc6423 req-5b2add9e-dfdb-4fb1-a273-146a17b1c4cf tempest-AttachVolumeTestJSON-1763649932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:40:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-85ae129a-6302-4e27-a1a4-cad5b0dc6423 req-5b2add9e-dfdb-4fb1-a273-146a17b1c4cf tempest-AttachVolumeTestJSON-1763649932 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac', 'name': 'volume-2bc948c6-0ef8-4a53-866c-50f13f3eeeb4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db02e7c4-5b80-44fc-9706-eeb5f3f11d7d', 'enforce_multipath': True} {{(pid=94328) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 27 03:40:01 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-85ae129a-6302-4e27-a1a4-cad5b0dc6423 req-5b2add9e-dfdb-4fb1-a273-146a17b1c4cf tempest-AttachVolumeTestJSON-1763649932 None] attachment_update completed successfully. Aug 27 03:40:14 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:40:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:40:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:40:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:40:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:40:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:40:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:40:14 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:40:14 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:40:15 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Aug 27 03:40:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.456s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:40:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:40:15 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager._thread_info {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:40:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread count: 8 {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 03:40:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread info: [<_MainThread(MainThread, started 134250325188736)>, , , , , , , ] {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 03:40:19 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:40:19 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:UPDATE=6,cinder:INSERT=1,cinder:SELECT=10 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:40:41 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-6bf0b890-b330-4a79-9ae9-8607371569ec req-648d2900-d67d-4945-a22b-0d62a5929a27 tempest-AttachVolumeTestJSON-1763649932 None] Terminate volume connection completed successfully. Aug 27 03:40:41 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-6bf0b890-b330-4a79-9ae9-8607371569ec req-648d2900-d67d-4945-a22b-0d62a5929a27 tempest-AttachVolumeTestJSON-1763649932 None] Deleting attachment db02e7c4-5b80-44fc-9706-eeb5f3f11d7d. {{(pid=94328) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 27 03:40:44 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:40:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Flow 'volume_create_manager' (42aa63d0-7fce-4b36-8d1f-7af3e8f0034e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:40:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060fcb82-da21-496e-a152-7ca35c396166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:40:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060fcb82-da21-496e-a152-7ca35c396166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-664345450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e08f8d-8099-4ec5-904e-c96c77df052b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea20be228b824592b6f3c419c84150b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:40:44Z,use_quota=True,user_id='fdb7cc1334214703947de7017ac0542e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:40:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9c0b71a-49e9-45eb-b9c8-cf2498617821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:40:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9c0b71a-49e9-45eb-b9c8-cf2498617821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:40:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (383d4313-28f3-4982-984f-1819d7ffffb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:40:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (383d4313-28f3-4982-984f-1819d7ffffb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44e08f8d-8099-4ec5-904e-c96c77df052b', 'volume_name': 'volume-44e08f8d-8099-4ec5-904e-c96c77df052b', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:40:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e92e082b-220f-4965-9204-aca7616a47c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:40:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e92e082b-220f-4965-9204-aca7616a47c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:40:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4889436-fcee-4344-9ebb-abcd31dc0376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:40:44 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Volume 44e08f8d-8099-4ec5-904e-c96c77df052b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44e08f8d-8099-4ec5-904e-c96c77df052b', 'volume_size': 1} Aug 27 03:40:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:40:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:40:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-664345450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e08f8d-8099-4ec5-904e-c96c77df052b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea20be228b824592b6f3c419c84150b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:40:44Z,use_quota=True,user_id='fdb7cc1334214703947de7017ac0542e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:40:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Creating volume 44e08f8d-8099-4ec5-904e-c96c77df052b {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:40:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:40:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:40:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:40:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:40:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:40:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:40:44 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:40:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-44e08f8d-8099-4ec5-904e-c96c77df052b 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:40:44 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-44e08f8d-8099-4ec5-904e-c96c77df052b 1073741824 Aug 27 03:40:44 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:40:45 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Aug 27 03:40:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-44e08f8d-8099-4ec5-904e-c96c77df052b 1073741824" returned: 0 in 0.653s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:40:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-44e08f8d-8099-4ec5-904e-c96c77df052b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:40:45 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-44e08f8d-8099-4ec5-904e-c96c77df052b Aug 27 03:40:45 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:40:45 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Aug 27 03:40:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-44e08f8d-8099-4ec5-904e-c96c77df052b" returned: 0 in 0.321s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:40:45 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:40:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:40:45 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4889436-fcee-4344-9ebb-abcd31dc0376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e08f8d-8099-4ec5-904e-c96c77df052b', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:40:45 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c143c541-419c-4113-9472-09dfb386c6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:40:45 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Volume volume-44e08f8d-8099-4ec5-904e-c96c77df052b (44e08f8d-8099-4ec5-904e-c96c77df052b): created successfully Aug 27 03:40:45 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c143c541-419c-4113-9472-09dfb386c6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:40:45 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Flow 'volume_create_manager' (42aa63d0-7fce-4b36-8d1f-7af3e8f0034e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:40:45 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-8a53cf5f-d158-41de-b141-1305fde13f2a tempest-ServerRescueNegativeTestJSON-755955627 None] Created volume successfully. Aug 27 03:40:46 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:40:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Flow 'volume_create_manager' (21cbeb64-5be1-4fd9-90dc-580227e3c4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:40:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e8223b-8770-4db5-b595-c8e4bec76c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:40:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e8223b-8770-4db5-b595-c8e4bec76c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1630466924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22de17e6-eb05-498a-8a5a-355de5a1e40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707a1187e598429b903156e5af764291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:40:46Z,use_quota=True,user_id='78c9792769cd4d6987a2297d11534c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:40:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7632f2ae-3458-41fd-bef4-2fbe5f5025ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:40:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7632f2ae-3458-41fd-bef4-2fbe5f5025ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:40:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8a77e7e-5766-4708-9ced-b57f1c285dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:40:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8a77e7e-5766-4708-9ced-b57f1c285dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22de17e6-eb05-498a-8a5a-355de5a1e40a', 'volume_name': 'volume-22de17e6-eb05-498a-8a5a-355de5a1e40a', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:40:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (191f219e-4990-4368-a4b9-8cd988b3bf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:40:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (191f219e-4990-4368-a4b9-8cd988b3bf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:40:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a3d74f8-a3fe-4d22-8164-fa80b041d273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:40:46 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Volume 22de17e6-eb05-498a-8a5a-355de5a1e40a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22de17e6-eb05-498a-8a5a-355de5a1e40a', 'volume_size': 1} Aug 27 03:40:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:40:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:40:46 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1630466924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22de17e6-eb05-498a-8a5a-355de5a1e40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707a1187e598429b903156e5af764291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:40:46Z,use_quota=True,user_id='78c9792769cd4d6987a2297d11534c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:40:46 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Creating volume 22de17e6-eb05-498a-8a5a-355de5a1e40a {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:40:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:40:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:40:46 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:40:46 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:40:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:40:46 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:40:46 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:40:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-22de17e6-eb05-498a-8a5a-355de5a1e40a 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:40:46 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-22de17e6-eb05-498a-8a5a-355de5a1e40a 1073741824 Aug 27 03:40:46 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:40:47 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Aug 27 03:40:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-22de17e6-eb05-498a-8a5a-355de5a1e40a 1073741824" returned: 0 in 0.861s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:40:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-22de17e6-eb05-498a-8a5a-355de5a1e40a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:40:47 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-22de17e6-eb05-498a-8a5a-355de5a1e40a Aug 27 03:40:47 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:40:48 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Aug 27 03:40:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-22de17e6-eb05-498a-8a5a-355de5a1e40a" returned: 0 in 0.535s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:40:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:40:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:40:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a3d74f8-a3fe-4d22-8164-fa80b041d273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22de17e6-eb05-498a-8a5a-355de5a1e40a', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:40:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b3ea54-4ba0-4677-a703-b0c9a9b92e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:40:48 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Volume volume-22de17e6-eb05-498a-8a5a-355de5a1e40a (22de17e6-eb05-498a-8a5a-355de5a1e40a): created successfully Aug 27 03:40:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b3ea54-4ba0-4677-a703-b0c9a9b92e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:40:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Flow 'volume_create_manager' (21cbeb64-5be1-4fd9-90dc-580227e3c4b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:40:48 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-694ea3e0-597d-4c29-9606-fc4ab1ac1bcd tempest-VolumeQuotasAdminTestJSON-256490344 None] Created volume successfully. Aug 27 03:40:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6c93a599-e606-4937-bb46-956e583d5dda tempest-VolumeQuotasAdminTestJSON-256490344 None] Acquiring lock "cinder-22de17e6-eb05-498a-8a5a-355de5a1e40a-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:40:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6c93a599-e606-4937-bb46-956e583d5dda tempest-VolumeQuotasAdminTestJSON-256490344 None] Lock "cinder-22de17e6-eb05-498a-8a5a-355de5a1e40a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:40:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6c93a599-e606-4937-bb46-956e583d5dda tempest-VolumeQuotasAdminTestJSON-256490344 None] Acquiring lock "cinder-quobyte-22de17e6-eb05-498a-8a5a-355de5a1e40a" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:40:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6c93a599-e606-4937-bb46-956e583d5dda tempest-VolumeQuotasAdminTestJSON-256490344 None] Lock "cinder-quobyte-22de17e6-eb05-498a-8a5a-355de5a1e40a" acquired by "delete_volume" :: waited 0.021s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:40:49 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[388a7f0a-e7f3-47f3-85f1-272975947a38]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:40:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6c93a599-e606-4937-bb46-956e583d5dda tempest-VolumeQuotasAdminTestJSON-256490344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-22de17e6-eb05-498a-8a5a-355de5a1e40a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:40:49 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-22de17e6-eb05-498a-8a5a-355de5a1e40a Aug 27 03:40:49 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:40:50 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Aug 27 03:40:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6c93a599-e606-4937-bb46-956e583d5dda tempest-VolumeQuotasAdminTestJSON-256490344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-22de17e6-eb05-498a-8a5a-355de5a1e40a" returned: 0 in 1.130s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:40:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6c93a599-e606-4937-bb46-956e583d5dda tempest-VolumeQuotasAdminTestJSON-256490344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-22de17e6-eb05-498a-8a5a-355de5a1e40a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:40:50 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-22de17e6-eb05-498a-8a5a-355de5a1e40a Aug 27 03:40:50 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:40:50 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Aug 27 03:40:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6c93a599-e606-4937-bb46-956e583d5dda tempest-VolumeQuotasAdminTestJSON-256490344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-22de17e6-eb05-498a-8a5a-355de5a1e40a" returned: 0 in 0.578s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:40:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6c93a599-e606-4937-bb46-956e583d5dda tempest-VolumeQuotasAdminTestJSON-256490344 None] Lock "cinder-quobyte-22de17e6-eb05-498a-8a5a-355de5a1e40a" released by "delete_volume" :: held 1.825s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:40:50 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-6c93a599-e606-4937-bb46-956e583d5dda tempest-VolumeQuotasAdminTestJSON-256490344 None] Created reservations ['963dd2ca-edb4-4e89-8348-76817db81f06', 'ad2e6d71-bc53-4902-a523-997d3236b333', '706cbd0c-cc7f-4d68-b9f5-b7f2571384c7', '64694770-6725-4971-bd36-0139220f3695'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:40:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6c93a599-e606-4937-bb46-956e583d5dda tempest-VolumeQuotasAdminTestJSON-256490344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:40:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6c93a599-e606-4937-bb46-956e583d5dda tempest-VolumeQuotasAdminTestJSON-256490344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:40:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-6c93a599-e606-4937-bb46-956e583d5dda tempest-VolumeQuotasAdminTestJSON-256490344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:40:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-6c93a599-e606-4937-bb46-956e583d5dda tempest-VolumeQuotasAdminTestJSON-256490344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:40:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6c93a599-e606-4937-bb46-956e583d5dda tempest-VolumeQuotasAdminTestJSON-256490344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:40:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6c93a599-e606-4937-bb46-956e583d5dda tempest-VolumeQuotasAdminTestJSON-256490344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:40:51 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:40:51 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:40:51 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Aug 27 03:40:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6c93a599-e606-4937-bb46-956e583d5dda tempest-VolumeQuotasAdminTestJSON-256490344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.505s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:40:51 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-6c93a599-e606-4937-bb46-956e583d5dda tempest-VolumeQuotasAdminTestJSON-256490344 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:40:51 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-6c93a599-e606-4937-bb46-956e583d5dda tempest-VolumeQuotasAdminTestJSON-256490344 None] Deleted volume successfully. Aug 27 03:40:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6c93a599-e606-4937-bb46-956e583d5dda tempest-VolumeQuotasAdminTestJSON-256490344 None] Lock "cinder-22de17e6-eb05-498a-8a5a-355de5a1e40a-delete_volume" released by "delete_volume" :: held 2.817s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:40:52 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:40:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Flow 'volume_create_manager' (7296935c-5acc-4ac4-af76-33ae8358f199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:40:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb9e45b-bbd1-4112-a8d9-45c8c79f8486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:40:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb9e45b-bbd1-4112-a8d9-45c8c79f8486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-701640673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=337597dc-3e91-4961-b3ff-efd3efed269d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707a1187e598429b903156e5af764291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:40:53Z,use_quota=True,user_id='78c9792769cd4d6987a2297d11534c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:40:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad65ece-cbcc-4f06-856b-935b4906b32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:40:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad65ece-cbcc-4f06-856b-935b4906b32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3dd10e9-0e88-4a45-8a84-bf8260c2acd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3dd10e9-0e88-4a45-8a84-bf8260c2acd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '337597dc-3e91-4961-b3ff-efd3efed269d', 'volume_name': 'volume-337597dc-3e91-4961-b3ff-efd3efed269d', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e36be02-c98b-4bf1-b167-ee3c5a4f7a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e36be02-c98b-4bf1-b167-ee3c5a4f7a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b5b4931-db2e-432b-81b1-13e491cc12b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:40:53 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Volume 337597dc-3e91-4961-b3ff-efd3efed269d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-337597dc-3e91-4961-b3ff-efd3efed269d', 'volume_size': 1} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-701640673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=337597dc-3e91-4961-b3ff-efd3efed269d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707a1187e598429b903156e5af764291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:40:53Z,use_quota=True,user_id='78c9792769cd4d6987a2297d11534c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Creating volume 337597dc-3e91-4961-b3ff-efd3efed269d {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:40:53 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-337597dc-3e91-4961-b3ff-efd3efed269d 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:40:53 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-337597dc-3e91-4961-b3ff-efd3efed269d 1073741824 Aug 27 03:40:53 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Flow 'volume_create_manager' (c334e54d-9e3d-4d42-92ff-87b06ca22a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece8149d-02ba-461f-b3fa-5619ab4c081e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece8149d-02ba-461f-b3fa-5619ab4c081e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-25964112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31e40ebc-8c9d-4465-905d-6f0c943f28b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fd6b4b6210443948fe827f250594eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:40:53Z,use_quota=True,user_id='a30358f01f404a6188cdf7ef01a4ee2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bcef782-91d0-49ff-b32f-d9c7419d0a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bcef782-91d0-49ff-b32f-d9c7419d0a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d4bf80-3c0b-400c-8608-645d5d4e591c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d4bf80-3c0b-400c-8608-645d5d4e591c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31e40ebc-8c9d-4465-905d-6f0c943f28b0', 'volume_name': 'volume-31e40ebc-8c9d-4465-905d-6f0c943f28b0', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08bbc693-226d-424f-9d5b-206bfc893100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08bbc693-226d-424f-9d5b-206bfc893100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb1d1f2-e6bd-4f61-aa9c-5b55d688a459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:40:53 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Volume 31e40ebc-8c9d-4465-905d-6f0c943f28b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31e40ebc-8c9d-4465-905d-6f0c943f28b0', 'volume_size': 1} Aug 27 03:40:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:40:54 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Aug 27 03:40:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-337597dc-3e91-4961-b3ff-efd3efed269d 1073741824" returned: 0 in 1.000s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:40:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-337597dc-3e91-4961-b3ff-efd3efed269d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:40:54 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-337597dc-3e91-4961-b3ff-efd3efed269d Aug 27 03:40:54 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:40:54 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Aug 27 03:40:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-337597dc-3e91-4961-b3ff-efd3efed269d" returned: 0 in 0.408s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:40:54 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:40:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:40:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.701s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:40:54 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-25964112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31e40ebc-8c9d-4465-905d-6f0c943f28b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fd6b4b6210443948fe827f250594eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:40:53Z,use_quota=True,user_id='a30358f01f404a6188cdf7ef01a4ee2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:40:54 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Creating volume 31e40ebc-8c9d-4465-905d-6f0c943f28b0 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:40:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:40:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:40:54 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:40:54 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:40:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:40:54 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:40:54 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:40:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-31e40ebc-8c9d-4465-905d-6f0c943f28b0 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:40:54 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-31e40ebc-8c9d-4465-905d-6f0c943f28b0 1073741824 Aug 27 03:40:54 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:40:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b5b4931-db2e-432b-81b1-13e491cc12b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-337597dc-3e91-4961-b3ff-efd3efed269d', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:40:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bd3621-1152-4ff7-ac7e-fb1930b8c2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:40:54 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Volume volume-337597dc-3e91-4961-b3ff-efd3efed269d (337597dc-3e91-4961-b3ff-efd3efed269d): created successfully Aug 27 03:40:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bd3621-1152-4ff7-ac7e-fb1930b8c2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:40:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Flow 'volume_create_manager' (7296935c-5acc-4ac4-af76-33ae8358f199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:40:54 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-1ff724a0-3334-41f7-8935-10da81b4dc15 tempest-VolumeQuotasAdminTestJSON-256490344 None] Created volume successfully. Aug 27 03:40:55 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Aug 27 03:40:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-31e40ebc-8c9d-4465-905d-6f0c943f28b0 1073741824" returned: 0 in 0.580s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:40:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-31e40ebc-8c9d-4465-905d-6f0c943f28b0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:40:55 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-31e40ebc-8c9d-4465-905d-6f0c943f28b0 Aug 27 03:40:55 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:40:55 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Aug 27 03:40:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-31e40ebc-8c9d-4465-905d-6f0c943f28b0" returned: 0 in 0.411s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:40:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:40:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:40:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb1d1f2-e6bd-4f61-aa9c-5b55d688a459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31e40ebc-8c9d-4465-905d-6f0c943f28b0', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:40:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20af449f-0617-4c60-b8a9-f528e47a5958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:40:55 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Volume volume-31e40ebc-8c9d-4465-905d-6f0c943f28b0 (31e40ebc-8c9d-4465-905d-6f0c943f28b0): created successfully Aug 27 03:40:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20af449f-0617-4c60-b8a9-f528e47a5958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:40:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Flow 'volume_create_manager' (c334e54d-9e3d-4d42-92ff-87b06ca22a3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:40:55 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f10958b9-da17-40cb-b7a0-a837735aff6a tempest-TaggedAttachmentsTest-909548316 None] Created volume successfully. Aug 27 03:40:56 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e0b2c79f-3fb5-42a0-900d-b036cce4194b tempest-VolumeQuotasAdminTestJSON-2123649392 None] Transfer volume completed successfully. Aug 27 03:40:56 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7b844a53-bf16-47cc-87e6-ba6b36c73ee3 tempest-VolumeQuotasAdminTestJSON-694104167 None] Acquiring lock "cinder-337597dc-3e91-4961-b3ff-efd3efed269d-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:40:56 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7b844a53-bf16-47cc-87e6-ba6b36c73ee3 tempest-VolumeQuotasAdminTestJSON-694104167 None] Lock "cinder-337597dc-3e91-4961-b3ff-efd3efed269d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:40:57 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7b844a53-bf16-47cc-87e6-ba6b36c73ee3 tempest-VolumeQuotasAdminTestJSON-694104167 None] Acquiring lock "cinder-quobyte-337597dc-3e91-4961-b3ff-efd3efed269d" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:40:57 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7b844a53-bf16-47cc-87e6-ba6b36c73ee3 tempest-VolumeQuotasAdminTestJSON-694104167 None] Lock "cinder-quobyte-337597dc-3e91-4961-b3ff-efd3efed269d" acquired by "delete_volume" :: waited 0.027s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:40:57 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f78b8c-2db7-46f2-af18-664a4e8a6153]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:40:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7b844a53-bf16-47cc-87e6-ba6b36c73ee3 tempest-VolumeQuotasAdminTestJSON-694104167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-337597dc-3e91-4961-b3ff-efd3efed269d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:40:57 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-337597dc-3e91-4961-b3ff-efd3efed269d Aug 27 03:40:57 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:40:57 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Aug 27 03:40:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7b844a53-bf16-47cc-87e6-ba6b36c73ee3 tempest-VolumeQuotasAdminTestJSON-694104167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-337597dc-3e91-4961-b3ff-efd3efed269d" returned: 0 in 0.559s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:40:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7b844a53-bf16-47cc-87e6-ba6b36c73ee3 tempest-VolumeQuotasAdminTestJSON-694104167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-337597dc-3e91-4961-b3ff-efd3efed269d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:40:57 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-337597dc-3e91-4961-b3ff-efd3efed269d Aug 27 03:40:57 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:40:58 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Aug 27 03:40:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7b844a53-bf16-47cc-87e6-ba6b36c73ee3 tempest-VolumeQuotasAdminTestJSON-694104167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-337597dc-3e91-4961-b3ff-efd3efed269d" returned: 0 in 0.485s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:40:58 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7b844a53-bf16-47cc-87e6-ba6b36c73ee3 tempest-VolumeQuotasAdminTestJSON-694104167 None] Lock "cinder-quobyte-337597dc-3e91-4961-b3ff-efd3efed269d" released by "delete_volume" :: held 1.156s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:40:58 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-7b844a53-bf16-47cc-87e6-ba6b36c73ee3 tempest-VolumeQuotasAdminTestJSON-694104167 None] Created reservations ['f9a5470b-7e43-4bdd-b22b-f0a4ebc04897', '022dbf1c-a9db-4486-91ae-51ac8709175b', '633dd7d7-d88c-4988-a587-207c423c0773', 'a53aab88-2bbe-46f5-aff3-1d325b52a673'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:40:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7b844a53-bf16-47cc-87e6-ba6b36c73ee3 tempest-VolumeQuotasAdminTestJSON-694104167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:40:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7b844a53-bf16-47cc-87e6-ba6b36c73ee3 tempest-VolumeQuotasAdminTestJSON-694104167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:40:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7b844a53-bf16-47cc-87e6-ba6b36c73ee3 tempest-VolumeQuotasAdminTestJSON-694104167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:40:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7b844a53-bf16-47cc-87e6-ba6b36c73ee3 tempest-VolumeQuotasAdminTestJSON-694104167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:40:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7b844a53-bf16-47cc-87e6-ba6b36c73ee3 tempest-VolumeQuotasAdminTestJSON-694104167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:40:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7b844a53-bf16-47cc-87e6-ba6b36c73ee3 tempest-VolumeQuotasAdminTestJSON-694104167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:40:58 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:40:58 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:40:58 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Aug 27 03:40:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7b844a53-bf16-47cc-87e6-ba6b36c73ee3 tempest-VolumeQuotasAdminTestJSON-694104167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.477s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:40:58 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-7b844a53-bf16-47cc-87e6-ba6b36c73ee3 tempest-VolumeQuotasAdminTestJSON-694104167 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:40:58 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-7b844a53-bf16-47cc-87e6-ba6b36c73ee3 tempest-VolumeQuotasAdminTestJSON-694104167 None] Deleted volume successfully. Aug 27 03:40:58 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7b844a53-bf16-47cc-87e6-ba6b36c73ee3 tempest-VolumeQuotasAdminTestJSON-694104167 None] Lock "cinder-337597dc-3e91-4961-b3ff-efd3efed269d-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:41:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8216de94-325a-4038-99e3-dc349c0b6f4a tempest-ServerRescueNegativeTestJSON-755955627 None] Acquiring lock "cinder-44e08f8d-8099-4ec5-904e-c96c77df052b-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:41:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8216de94-325a-4038-99e3-dc349c0b6f4a tempest-ServerRescueNegativeTestJSON-755955627 None] Lock "cinder-44e08f8d-8099-4ec5-904e-c96c77df052b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:41:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8216de94-325a-4038-99e3-dc349c0b6f4a tempest-ServerRescueNegativeTestJSON-755955627 None] Acquiring lock "cinder-quobyte-44e08f8d-8099-4ec5-904e-c96c77df052b" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:41:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8216de94-325a-4038-99e3-dc349c0b6f4a tempest-ServerRescueNegativeTestJSON-755955627 None] Lock "cinder-quobyte-44e08f8d-8099-4ec5-904e-c96c77df052b" acquired by "delete_volume" :: waited 0.031s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:41:05 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b29aec1-1989-4035-9b63-ea8ea6b02fc4]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:41:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8216de94-325a-4038-99e3-dc349c0b6f4a tempest-ServerRescueNegativeTestJSON-755955627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-44e08f8d-8099-4ec5-904e-c96c77df052b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:06 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-44e08f8d-8099-4ec5-904e-c96c77df052b Aug 27 03:41:06 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:06 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8216de94-325a-4038-99e3-dc349c0b6f4a tempest-ServerRescueNegativeTestJSON-755955627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-44e08f8d-8099-4ec5-904e-c96c77df052b" returned: 0 in 1.054s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8216de94-325a-4038-99e3-dc349c0b6f4a tempest-ServerRescueNegativeTestJSON-755955627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-44e08f8d-8099-4ec5-904e-c96c77df052b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:06 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-44e08f8d-8099-4ec5-904e-c96c77df052b Aug 27 03:41:06 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:07 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8216de94-325a-4038-99e3-dc349c0b6f4a tempest-ServerRescueNegativeTestJSON-755955627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-44e08f8d-8099-4ec5-904e-c96c77df052b" returned: 0 in 0.547s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8216de94-325a-4038-99e3-dc349c0b6f4a tempest-ServerRescueNegativeTestJSON-755955627 None] Lock "cinder-quobyte-44e08f8d-8099-4ec5-904e-c96c77df052b" released by "delete_volume" :: held 1.723s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:41:07 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-8216de94-325a-4038-99e3-dc349c0b6f4a tempest-ServerRescueNegativeTestJSON-755955627 None] Created reservations ['15512534-f8e0-407a-8806-1c53a7c061ad', '436ebf8e-09b2-49e4-bb43-14e3b1800d98', '5aacb101-d185-450d-9fa1-4fa7cbb38e93', '44d91b79-c96b-4480-b779-522b5dcc361e'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:41:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8216de94-325a-4038-99e3-dc349c0b6f4a tempest-ServerRescueNegativeTestJSON-755955627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:41:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8216de94-325a-4038-99e3-dc349c0b6f4a tempest-ServerRescueNegativeTestJSON-755955627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:41:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8216de94-325a-4038-99e3-dc349c0b6f4a tempest-ServerRescueNegativeTestJSON-755955627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:41:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8216de94-325a-4038-99e3-dc349c0b6f4a tempest-ServerRescueNegativeTestJSON-755955627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:41:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8216de94-325a-4038-99e3-dc349c0b6f4a tempest-ServerRescueNegativeTestJSON-755955627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:41:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8216de94-325a-4038-99e3-dc349c0b6f4a tempest-ServerRescueNegativeTestJSON-755955627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:08 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:41:08 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:08 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8216de94-325a-4038-99e3-dc349c0b6f4a tempest-ServerRescueNegativeTestJSON-755955627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.569s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:08 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-8216de94-325a-4038-99e3-dc349c0b6f4a tempest-ServerRescueNegativeTestJSON-755955627 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:41:08 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-8216de94-325a-4038-99e3-dc349c0b6f4a tempest-ServerRescueNegativeTestJSON-755955627 None] Deleted volume successfully. Aug 27 03:41:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8216de94-325a-4038-99e3-dc349c0b6f4a tempest-ServerRescueNegativeTestJSON-755955627 None] Lock "cinder-44e08f8d-8099-4ec5-904e-c96c77df052b-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:41:14 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:41:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:41:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:41:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:41:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:41:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:41:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:14 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:41:14 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:15 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:41:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Flow 'volume_create_manager' (15b216c5-7b3d-411d-953f-ab1a0bf9490e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:41:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6fc3180-330a-4f46-b8a4-ce22c6e1daa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6fc3180-330a-4f46-b8a4-ce22c6e1daa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-623795977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26474ebb-c21d-49d0-81b9-4814b3ef24cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a380c9a5584b64a6f41ed53400be59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:41:15Z,use_quota=True,user_id='f484a32ff7c148ac9b880d36c8cacc9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b919929e-39cf-4e11-bf3d-553d86f36fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b919929e-39cf-4e11-bf3d-553d86f36fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8cde614-1b03-4a54-a48d-ec627c5bca71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8cde614-1b03-4a54-a48d-ec627c5bca71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26474ebb-c21d-49d0-81b9-4814b3ef24cc', 'volume_name': 'volume-26474ebb-c21d-49d0-81b9-4814b3ef24cc', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ee1cae-7225-47e8-98c9-2019ad02abcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ee1cae-7225-47e8-98c9-2019ad02abcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:15 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b921a0c2-f9d9-496a-8eb6-56967f89c376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:15 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Volume 26474ebb-c21d-49d0-81b9-4814b3ef24cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26474ebb-c21d-49d0-81b9-4814b3ef24cc', 'volume_size': 1} Aug 27 03:41:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:41:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:41:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-623795977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26474ebb-c21d-49d0-81b9-4814b3ef24cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a380c9a5584b64a6f41ed53400be59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:41:15Z,use_quota=True,user_id='f484a32ff7c148ac9b880d36c8cacc9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:41:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Creating volume 26474ebb-c21d-49d0-81b9-4814b3ef24cc {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:41:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:41:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:41:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:41:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:41:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:41:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:41:15 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:41:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-26474ebb-c21d-49d0-81b9-4814b3ef24cc 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.450s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:41:15 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-26474ebb-c21d-49d0-81b9-4814b3ef24cc 1073741824 Aug 27 03:41:15 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:16 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-26474ebb-c21d-49d0-81b9-4814b3ef24cc 1073741824" returned: 0 in 0.866s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-26474ebb-c21d-49d0-81b9-4814b3ef24cc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:16 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-26474ebb-c21d-49d0-81b9-4814b3ef24cc Aug 27 03:41:16 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:16 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-26474ebb-c21d-49d0-81b9-4814b3ef24cc" returned: 0 in 0.425s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:16 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:41:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:41:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b921a0c2-f9d9-496a-8eb6-56967f89c376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26474ebb-c21d-49d0-81b9-4814b3ef24cc', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94278269-f424-4afe-a8e4-12de761dbf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:16 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Volume volume-26474ebb-c21d-49d0-81b9-4814b3ef24cc (26474ebb-c21d-49d0-81b9-4814b3ef24cc): created successfully Aug 27 03:41:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94278269-f424-4afe-a8e4-12de761dbf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Flow 'volume_create_manager' (15b216c5-7b3d-411d-953f-ab1a0bf9490e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:41:16 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-02893fe7-2192-49d4-9cc9-70f9cad5955f tempest-VolumeQuotasNegativeTestJSON-212390184 None] Created volume successfully. Aug 27 03:41:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-20565fb8-ba98-4c61-ab34-e87386567962 tempest-VolumeQuotasNegativeTestJSON-212390184 None] Acquiring lock "cinder-26474ebb-c21d-49d0-81b9-4814b3ef24cc-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:41:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-20565fb8-ba98-4c61-ab34-e87386567962 tempest-VolumeQuotasNegativeTestJSON-212390184 None] Lock "cinder-26474ebb-c21d-49d0-81b9-4814b3ef24cc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:41:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-20565fb8-ba98-4c61-ab34-e87386567962 tempest-VolumeQuotasNegativeTestJSON-212390184 None] Acquiring lock "cinder-quobyte-26474ebb-c21d-49d0-81b9-4814b3ef24cc" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:41:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-20565fb8-ba98-4c61-ab34-e87386567962 tempest-VolumeQuotasNegativeTestJSON-212390184 None] Lock "cinder-quobyte-26474ebb-c21d-49d0-81b9-4814b3ef24cc" acquired by "delete_volume" :: waited 0.037s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:41:18 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d31795-e286-4759-995a-c72da84e86aa]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:41:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-20565fb8-ba98-4c61-ab34-e87386567962 tempest-VolumeQuotasNegativeTestJSON-212390184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-26474ebb-c21d-49d0-81b9-4814b3ef24cc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:19 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-26474ebb-c21d-49d0-81b9-4814b3ef24cc Aug 27 03:41:19 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:19 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-20565fb8-ba98-4c61-ab34-e87386567962 tempest-VolumeQuotasNegativeTestJSON-212390184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-26474ebb-c21d-49d0-81b9-4814b3ef24cc" returned: 0 in 0.477s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-20565fb8-ba98-4c61-ab34-e87386567962 tempest-VolumeQuotasNegativeTestJSON-212390184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-26474ebb-c21d-49d0-81b9-4814b3ef24cc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:19 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-26474ebb-c21d-49d0-81b9-4814b3ef24cc Aug 27 03:41:19 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:19 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-20565fb8-ba98-4c61-ab34-e87386567962 tempest-VolumeQuotasNegativeTestJSON-212390184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-26474ebb-c21d-49d0-81b9-4814b3ef24cc" returned: 0 in 0.381s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-20565fb8-ba98-4c61-ab34-e87386567962 tempest-VolumeQuotasNegativeTestJSON-212390184 None] Lock "cinder-quobyte-26474ebb-c21d-49d0-81b9-4814b3ef24cc" released by "delete_volume" :: held 0.932s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:41:19 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-20565fb8-ba98-4c61-ab34-e87386567962 tempest-VolumeQuotasNegativeTestJSON-212390184 None] Created reservations ['0be311ab-cb53-4e6d-8dc2-08d615ff67c9', 'fcd3f5f3-d3d4-4601-937b-76752a60d571', '2d8bf197-855e-4f13-aa3f-01c8f64ebd05', '12978573-1106-422c-87d6-c12043313de8'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:41:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-20565fb8-ba98-4c61-ab34-e87386567962 tempest-VolumeQuotasNegativeTestJSON-212390184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:41:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-20565fb8-ba98-4c61-ab34-e87386567962 tempest-VolumeQuotasNegativeTestJSON-212390184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:41:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-20565fb8-ba98-4c61-ab34-e87386567962 tempest-VolumeQuotasNegativeTestJSON-212390184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:41:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-20565fb8-ba98-4c61-ab34-e87386567962 tempest-VolumeQuotasNegativeTestJSON-212390184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:41:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-20565fb8-ba98-4c61-ab34-e87386567962 tempest-VolumeQuotasNegativeTestJSON-212390184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:41:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-20565fb8-ba98-4c61-ab34-e87386567962 tempest-VolumeQuotasNegativeTestJSON-212390184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:20 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:41:20 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:20 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-20565fb8-ba98-4c61-ab34-e87386567962 tempest-VolumeQuotasNegativeTestJSON-212390184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.294s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:20 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-20565fb8-ba98-4c61-ab34-e87386567962 tempest-VolumeQuotasNegativeTestJSON-212390184 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:41:20 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-20565fb8-ba98-4c61-ab34-e87386567962 tempest-VolumeQuotasNegativeTestJSON-212390184 None] Deleted volume successfully. Aug 27 03:41:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-20565fb8-ba98-4c61-ab34-e87386567962 tempest-VolumeQuotasNegativeTestJSON-212390184 None] Lock "cinder-26474ebb-c21d-49d0-81b9-4814b3ef24cc-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:41:26 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:41:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Flow 'volume_create_manager' (c034ceed-44b2-4364-aeef-a2200ef1257e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:41:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4da5c8c-c157-40c6-a5d9-6ad2ae33b0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4da5c8c-c157-40c6-a5d9-6ad2ae33b0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-667957223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88eb7ceb-fdde-438d-abff-af340253f061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dfbe5ede08430f8ff14e2d4e6fdf84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:41:26Z,use_quota=True,user_id='541fb4a17b5a43e59d209f0050b69902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f3ffea-34ce-4135-b528-bbe867138eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f3ffea-34ce-4135-b528-bbe867138eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (342409cc-45d8-4cc2-a472-7b0cf26d6f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (342409cc-45d8-4cc2-a472-7b0cf26d6f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88eb7ceb-fdde-438d-abff-af340253f061', 'volume_name': 'volume-88eb7ceb-fdde-438d-abff-af340253f061', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e03d62-9e67-4b52-a28a-edf871b5f4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e03d62-9e67-4b52-a28a-edf871b5f4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91dc55aa-d157-4dee-bae7-81920bc52769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:26 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Volume 88eb7ceb-fdde-438d-abff-af340253f061: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88eb7ceb-fdde-438d-abff-af340253f061', 'volume_size': 1} Aug 27 03:41:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:41:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:41:26 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-667957223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88eb7ceb-fdde-438d-abff-af340253f061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dfbe5ede08430f8ff14e2d4e6fdf84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:41:26Z,use_quota=True,user_id='541fb4a17b5a43e59d209f0050b69902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:41:26 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Creating volume 88eb7ceb-fdde-438d-abff-af340253f061 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:41:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:41:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:41:26 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:41:26 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:41:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:41:26 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:41:26 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:41:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-88eb7ceb-fdde-438d-abff-af340253f061 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:26 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-88eb7ceb-fdde-438d-abff-af340253f061 1073741824 Aug 27 03:41:26 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:27 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-88eb7ceb-fdde-438d-abff-af340253f061 1073741824" returned: 0 in 0.537s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-88eb7ceb-fdde-438d-abff-af340253f061 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:27 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-88eb7ceb-fdde-438d-abff-af340253f061 Aug 27 03:41:27 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:27 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-88eb7ceb-fdde-438d-abff-af340253f061" returned: 0 in 0.274s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:41:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:41:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91dc55aa-d157-4dee-bae7-81920bc52769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88eb7ceb-fdde-438d-abff-af340253f061', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96d29f7-8114-4a51-a35c-aa42b4d24fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:27 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Volume volume-88eb7ceb-fdde-438d-abff-af340253f061 (88eb7ceb-fdde-438d-abff-af340253f061): created successfully Aug 27 03:41:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96d29f7-8114-4a51-a35c-aa42b4d24fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Flow 'volume_create_manager' (c034ceed-44b2-4364-aeef-a2200ef1257e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:41:27 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-cefc6cd1-d5af-4524-ab9c-fb6b5115b06f tempest-VolumesListAdminTestJSON-1821048283 None] Created volume successfully. Aug 27 03:41:29 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:41:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Flow 'volume_create_manager' (19becff8-e63c-40ee-a9ac-ca9b6328699e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:41:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b643d970-91b5-4c83-8b43-a58870c9d1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b643d970-91b5-4c83-8b43-a58870c9d1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1758766602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7644b1cb-47d5-4d0d-aa16-80585075d511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dfbe5ede08430f8ff14e2d4e6fdf84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:41:29Z,use_quota=True,user_id='541fb4a17b5a43e59d209f0050b69902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc236647-af08-4990-af64-ae08597a985f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc236647-af08-4990-af64-ae08597a985f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c66e082b-5aa5-4f83-adc6-6cdcf7f98b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c66e082b-5aa5-4f83-adc6-6cdcf7f98b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7644b1cb-47d5-4d0d-aa16-80585075d511', 'volume_name': 'volume-7644b1cb-47d5-4d0d-aa16-80585075d511', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2efbe535-b0b5-4cb3-bd8d-b11fe5529887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2efbe535-b0b5-4cb3-bd8d-b11fe5529887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93397750-9287-4c1d-a4d3-4daf165b0fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:29 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Volume 7644b1cb-47d5-4d0d-aa16-80585075d511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7644b1cb-47d5-4d0d-aa16-80585075d511', 'volume_size': 1} Aug 27 03:41:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:41:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:41:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1758766602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7644b1cb-47d5-4d0d-aa16-80585075d511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dfbe5ede08430f8ff14e2d4e6fdf84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:41:29Z,use_quota=True,user_id='541fb4a17b5a43e59d209f0050b69902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:41:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Creating volume 7644b1cb-47d5-4d0d-aa16-80585075d511 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:41:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:41:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:41:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:41:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:41:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:41:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:41:29 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:41:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7644b1cb-47d5-4d0d-aa16-80585075d511 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:29 devstack sudo[98089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7644b1cb-47d5-4d0d-aa16-80585075d511 1073741824 Aug 27 03:41:29 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:29 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7644b1cb-47d5-4d0d-aa16-80585075d511 1073741824" returned: 0 in 0.470s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7644b1cb-47d5-4d0d-aa16-80585075d511 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:29 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7644b1cb-47d5-4d0d-aa16-80585075d511 Aug 27 03:41:29 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:30 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7644b1cb-47d5-4d0d-aa16-80585075d511" returned: 0 in 0.251s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:41:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:41:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93397750-9287-4c1d-a4d3-4daf165b0fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7644b1cb-47d5-4d0d-aa16-80585075d511', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7abfacc9-656d-4b04-804c-4d5bc518afa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:30 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Volume volume-7644b1cb-47d5-4d0d-aa16-80585075d511 (7644b1cb-47d5-4d0d-aa16-80585075d511): created successfully Aug 27 03:41:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7abfacc9-656d-4b04-804c-4d5bc518afa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Flow 'volume_create_manager' (19becff8-e63c-40ee-a9ac-ca9b6328699e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:41:30 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-fe4e1e95-0f04-4a3f-b131-1e528d20fe3e tempest-VolumesListAdminTestJSON-1821048283 None] Created volume successfully. Aug 27 03:41:31 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:41:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Flow 'volume_create_manager' (cc97ffce-baa0-45b5-8fc9-cbd17ee4015a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:41:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d48f1d23-b2a6-4d7b-ae2b-235369349760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d48f1d23-b2a6-4d7b-ae2b-235369349760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-77275434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800889de-8064-4d20-a0a1-485fcb847e6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dfbe5ede08430f8ff14e2d4e6fdf84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:41:32Z,use_quota=True,user_id='541fb4a17b5a43e59d209f0050b69902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df1848fe-9408-4114-986e-91d1d119fbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df1848fe-9408-4114-986e-91d1d119fbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d012fc0d-a732-4699-9302-1caaf0e9c69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d012fc0d-a732-4699-9302-1caaf0e9c69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '800889de-8064-4d20-a0a1-485fcb847e6e', 'volume_name': 'volume-800889de-8064-4d20-a0a1-485fcb847e6e', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c1bcd9-cd50-44a2-8088-80ce3b95af07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c1bcd9-cd50-44a2-8088-80ce3b95af07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f409f3ad-1e24-4450-8a91-0dbb17fabed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:31 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Volume 800889de-8064-4d20-a0a1-485fcb847e6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-800889de-8064-4d20-a0a1-485fcb847e6e', 'volume_size': 1} Aug 27 03:41:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:41:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:41:31 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-77275434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800889de-8064-4d20-a0a1-485fcb847e6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dfbe5ede08430f8ff14e2d4e6fdf84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:41:32Z,use_quota=True,user_id='541fb4a17b5a43e59d209f0050b69902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:41:31 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Creating volume 800889de-8064-4d20-a0a1-485fcb847e6e {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:41:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:41:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:41:31 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:41:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:41:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:41:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:41:32 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:41:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-800889de-8064-4d20-a0a1-485fcb847e6e 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:32 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-800889de-8064-4d20-a0a1-485fcb847e6e 1073741824 Aug 27 03:41:32 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:32 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-800889de-8064-4d20-a0a1-485fcb847e6e 1073741824" returned: 0 in 0.632s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-800889de-8064-4d20-a0a1-485fcb847e6e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:32 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-800889de-8064-4d20-a0a1-485fcb847e6e Aug 27 03:41:32 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:32 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-800889de-8064-4d20-a0a1-485fcb847e6e" returned: 0 in 0.275s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:41:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:41:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f409f3ad-1e24-4450-8a91-0dbb17fabed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-800889de-8064-4d20-a0a1-485fcb847e6e', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15ce07f4-477e-4d9a-a1b0-db97febecae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:33 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Volume volume-800889de-8064-4d20-a0a1-485fcb847e6e (800889de-8064-4d20-a0a1-485fcb847e6e): created successfully Aug 27 03:41:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15ce07f4-477e-4d9a-a1b0-db97febecae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Flow 'volume_create_manager' (cc97ffce-baa0-45b5-8fc9-cbd17ee4015a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:41:33 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-2e4bdbfd-e15f-440d-b082-9e48edd1c0f7 tempest-VolumesListAdminTestJSON-1821048283 None] Created volume successfully. Aug 27 03:41:34 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:41:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Flow 'volume_create_manager' (57c85c80-7385-44b3-b11c-6d4b2d1e5f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:41:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b93aab0-bd74-4bab-98aa-e9adf3f8955b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b93aab0-bd74-4bab-98aa-e9adf3f8955b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=744a96a3-e7f7-4d29-8959-c44d979947df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57022947c5ca4ff297b72aabbcafa781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:41:35Z,use_quota=True,user_id='0c575358a59c4c19be76995daff5a4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c84e34-911c-44ac-9a29-3155468fe918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c84e34-911c-44ac-9a29-3155468fe918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ae015e-299e-4f30-9ec9-25a9821a5416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ae015e-299e-4f30-9ec9-25a9821a5416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '744a96a3-e7f7-4d29-8959-c44d979947df', 'volume_name': 'volume-744a96a3-e7f7-4d29-8959-c44d979947df', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0807630b-6d50-4733-a69f-717fb6c7a110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0807630b-6d50-4733-a69f-717fb6c7a110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6998c52c-0843-41b0-b23b-c28aeec461b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:34 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Volume 744a96a3-e7f7-4d29-8959-c44d979947df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-744a96a3-e7f7-4d29-8959-c44d979947df', 'volume_size': 1} Aug 27 03:41:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:41:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:41:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=744a96a3-e7f7-4d29-8959-c44d979947df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57022947c5ca4ff297b72aabbcafa781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:41:35Z,use_quota=True,user_id='0c575358a59c4c19be76995daff5a4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:41:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Creating volume 744a96a3-e7f7-4d29-8959-c44d979947df {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:41:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:41:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:41:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:41:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:41:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:41:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:41:34 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:41:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-744a96a3-e7f7-4d29-8959-c44d979947df 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:34 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-744a96a3-e7f7-4d29-8959-c44d979947df 1073741824 Aug 27 03:41:34 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:35 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-744a96a3-e7f7-4d29-8959-c44d979947df 1073741824" returned: 0 in 0.613s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-744a96a3-e7f7-4d29-8959-c44d979947df {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:35 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-744a96a3-e7f7-4d29-8959-c44d979947df Aug 27 03:41:35 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:36 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-744a96a3-e7f7-4d29-8959-c44d979947df" returned: 0 in 0.403s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:36 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:41:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:41:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6998c52c-0843-41b0-b23b-c28aeec461b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-744a96a3-e7f7-4d29-8959-c44d979947df', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b769004d-0ff0-4afd-a009-5481744a5199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:41:36 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Volume volume-744a96a3-e7f7-4d29-8959-c44d979947df (744a96a3-e7f7-4d29-8959-c44d979947df): created successfully Aug 27 03:41:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b769004d-0ff0-4afd-a009-5481744a5199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:41:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Flow 'volume_create_manager' (57c85c80-7385-44b3-b11c-6d4b2d1e5f30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:41:36 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d33ce032-199c-4d18-a8c7-fd014f957b4b tempest-VolumesListAdminTestJSON-420313788 None] Created volume successfully. Aug 27 03:41:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6a2df97b-5d8a-4049-9e8c-718c29ea50af tempest-VolumesListAdminTestJSON-420313788 None] Acquiring lock "cinder-744a96a3-e7f7-4d29-8959-c44d979947df-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:41:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6a2df97b-5d8a-4049-9e8c-718c29ea50af tempest-VolumesListAdminTestJSON-420313788 None] Lock "cinder-744a96a3-e7f7-4d29-8959-c44d979947df-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:41:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6a2df97b-5d8a-4049-9e8c-718c29ea50af tempest-VolumesListAdminTestJSON-420313788 None] Acquiring lock "cinder-quobyte-744a96a3-e7f7-4d29-8959-c44d979947df" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:41:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6a2df97b-5d8a-4049-9e8c-718c29ea50af tempest-VolumesListAdminTestJSON-420313788 None] Lock "cinder-quobyte-744a96a3-e7f7-4d29-8959-c44d979947df" acquired by "delete_volume" :: waited 0.023s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:41:37 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd5268d-ed8f-477f-ae4f-1da3ea5b1119]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:41:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6a2df97b-5d8a-4049-9e8c-718c29ea50af tempest-VolumesListAdminTestJSON-420313788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-744a96a3-e7f7-4d29-8959-c44d979947df {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9422b4b2-6dc8-455f-a62b-18fd3a5d43db tempest-VolumesListAdminTestJSON-1821048283 None] Acquiring lock "cinder-800889de-8064-4d20-a0a1-485fcb847e6e-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:41:37 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-744a96a3-e7f7-4d29-8959-c44d979947df Aug 27 03:41:37 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9422b4b2-6dc8-455f-a62b-18fd3a5d43db tempest-VolumesListAdminTestJSON-1821048283 None] Lock "cinder-800889de-8064-4d20-a0a1-485fcb847e6e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:41:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9422b4b2-6dc8-455f-a62b-18fd3a5d43db tempest-VolumesListAdminTestJSON-1821048283 None] Acquiring lock "cinder-quobyte-800889de-8064-4d20-a0a1-485fcb847e6e" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:41:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9422b4b2-6dc8-455f-a62b-18fd3a5d43db tempest-VolumesListAdminTestJSON-1821048283 None] Lock "cinder-quobyte-800889de-8064-4d20-a0a1-485fcb847e6e" acquired by "delete_volume" :: waited 0.038s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:41:37 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd7488a-3d63-4a0a-a752-2e16550afc59]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:41:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9422b4b2-6dc8-455f-a62b-18fd3a5d43db tempest-VolumesListAdminTestJSON-1821048283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-800889de-8064-4d20-a0a1-485fcb847e6e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:37 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-800889de-8064-4d20-a0a1-485fcb847e6e Aug 27 03:41:37 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:37 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6a2df97b-5d8a-4049-9e8c-718c29ea50af tempest-VolumesListAdminTestJSON-420313788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-744a96a3-e7f7-4d29-8959-c44d979947df" returned: 0 in 0.520s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6a2df97b-5d8a-4049-9e8c-718c29ea50af tempest-VolumesListAdminTestJSON-420313788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-744a96a3-e7f7-4d29-8959-c44d979947df {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:37 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-744a96a3-e7f7-4d29-8959-c44d979947df Aug 27 03:41:37 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:38 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9422b4b2-6dc8-455f-a62b-18fd3a5d43db tempest-VolumesListAdminTestJSON-1821048283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-800889de-8064-4d20-a0a1-485fcb847e6e" returned: 0 in 0.541s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9422b4b2-6dc8-455f-a62b-18fd3a5d43db tempest-VolumesListAdminTestJSON-1821048283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-800889de-8064-4d20-a0a1-485fcb847e6e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:38 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-800889de-8064-4d20-a0a1-485fcb847e6e Aug 27 03:41:38 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:38 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6a2df97b-5d8a-4049-9e8c-718c29ea50af tempest-VolumesListAdminTestJSON-420313788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-744a96a3-e7f7-4d29-8959-c44d979947df" returned: 0 in 0.371s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:38 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6a2df97b-5d8a-4049-9e8c-718c29ea50af tempest-VolumesListAdminTestJSON-420313788 None] Lock "cinder-quobyte-744a96a3-e7f7-4d29-8959-c44d979947df" released by "delete_volume" :: held 0.966s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:41:38 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-6a2df97b-5d8a-4049-9e8c-718c29ea50af tempest-VolumesListAdminTestJSON-420313788 None] Created reservations ['3a505ee6-e51c-4784-8813-63bc0c4af27d', '160b8587-2375-42a4-aef7-691978c28578', '3fe7b138-111d-4b7d-8f9b-c781fb315d81', '04101ae5-f078-4e85-a9bd-6225023447e1'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:41:38 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9422b4b2-6dc8-455f-a62b-18fd3a5d43db tempest-VolumesListAdminTestJSON-1821048283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-800889de-8064-4d20-a0a1-485fcb847e6e" returned: 0 in 0.304s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:38 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9422b4b2-6dc8-455f-a62b-18fd3a5d43db tempest-VolumesListAdminTestJSON-1821048283 None] Lock "cinder-quobyte-800889de-8064-4d20-a0a1-485fcb847e6e" released by "delete_volume" :: held 0.917s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:41:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6a2df97b-5d8a-4049-9e8c-718c29ea50af tempest-VolumesListAdminTestJSON-420313788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:41:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6a2df97b-5d8a-4049-9e8c-718c29ea50af tempest-VolumesListAdminTestJSON-420313788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:41:38 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-6a2df97b-5d8a-4049-9e8c-718c29ea50af tempest-VolumesListAdminTestJSON-420313788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:41:38 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-6a2df97b-5d8a-4049-9e8c-718c29ea50af tempest-VolumesListAdminTestJSON-420313788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:41:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6a2df97b-5d8a-4049-9e8c-718c29ea50af tempest-VolumesListAdminTestJSON-420313788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:41:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6a2df97b-5d8a-4049-9e8c-718c29ea50af tempest-VolumesListAdminTestJSON-420313788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:38 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:41:38 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:38 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-9422b4b2-6dc8-455f-a62b-18fd3a5d43db tempest-VolumesListAdminTestJSON-1821048283 None] Created reservations ['cd0b3bea-4b53-4ffb-b752-178f66889a8d', '1813cad6-35e3-4268-b30c-aa6a0878c2db', 'f7d047d3-3128-4b64-917d-dd3a7f8f3b06', '72381abf-55b9-4075-ab57-9d394c8ce680'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:41:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9422b4b2-6dc8-455f-a62b-18fd3a5d43db tempest-VolumesListAdminTestJSON-1821048283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:41:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9422b4b2-6dc8-455f-a62b-18fd3a5d43db tempest-VolumesListAdminTestJSON-1821048283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:41:38 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-9422b4b2-6dc8-455f-a62b-18fd3a5d43db tempest-VolumesListAdminTestJSON-1821048283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:41:38 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-9422b4b2-6dc8-455f-a62b-18fd3a5d43db tempest-VolumesListAdminTestJSON-1821048283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:41:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9422b4b2-6dc8-455f-a62b-18fd3a5d43db tempest-VolumesListAdminTestJSON-1821048283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:41:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9422b4b2-6dc8-455f-a62b-18fd3a5d43db tempest-VolumesListAdminTestJSON-1821048283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:38 devstack sudo[98169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:41:38 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:38 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6a2df97b-5d8a-4049-9e8c-718c29ea50af tempest-VolumesListAdminTestJSON-420313788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.337s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:38 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-6a2df97b-5d8a-4049-9e8c-718c29ea50af tempest-VolumesListAdminTestJSON-420313788 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:41:38 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-6a2df97b-5d8a-4049-9e8c-718c29ea50af tempest-VolumesListAdminTestJSON-420313788 None] Deleted volume successfully. Aug 27 03:41:38 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6a2df97b-5d8a-4049-9e8c-718c29ea50af tempest-VolumesListAdminTestJSON-420313788 None] Lock "cinder-744a96a3-e7f7-4d29-8959-c44d979947df-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:41:39 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9422b4b2-6dc8-455f-a62b-18fd3a5d43db tempest-VolumesListAdminTestJSON-1821048283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.334s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:39 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-9422b4b2-6dc8-455f-a62b-18fd3a5d43db tempest-VolumesListAdminTestJSON-1821048283 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:41:39 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-9422b4b2-6dc8-455f-a62b-18fd3a5d43db tempest-VolumesListAdminTestJSON-1821048283 None] Deleted volume successfully. Aug 27 03:41:39 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9422b4b2-6dc8-455f-a62b-18fd3a5d43db tempest-VolumesListAdminTestJSON-1821048283 None] Lock "cinder-800889de-8064-4d20-a0a1-485fcb847e6e-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:41:39 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-75962aab-0d38-4b9e-b4b1-17449b97591a tempest-VolumesListAdminTestJSON-1821048283 None] Acquiring lock "cinder-7644b1cb-47d5-4d0d-aa16-80585075d511-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:41:39 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-75962aab-0d38-4b9e-b4b1-17449b97591a tempest-VolumesListAdminTestJSON-1821048283 None] Lock "cinder-7644b1cb-47d5-4d0d-aa16-80585075d511-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:41:39 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-75962aab-0d38-4b9e-b4b1-17449b97591a tempest-VolumesListAdminTestJSON-1821048283 None] Acquiring lock "cinder-quobyte-7644b1cb-47d5-4d0d-aa16-80585075d511" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:41:39 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-75962aab-0d38-4b9e-b4b1-17449b97591a tempest-VolumesListAdminTestJSON-1821048283 None] Lock "cinder-quobyte-7644b1cb-47d5-4d0d-aa16-80585075d511" acquired by "delete_volume" :: waited 0.031s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:41:40 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ada21e5-1d46-4ee3-98d8-c8894cdcb985]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:41:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-75962aab-0d38-4b9e-b4b1-17449b97591a tempest-VolumesListAdminTestJSON-1821048283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7644b1cb-47d5-4d0d-aa16-80585075d511 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:40 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7644b1cb-47d5-4d0d-aa16-80585075d511 Aug 27 03:41:40 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:40 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-75962aab-0d38-4b9e-b4b1-17449b97591a tempest-VolumesListAdminTestJSON-1821048283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7644b1cb-47d5-4d0d-aa16-80585075d511" returned: 0 in 0.737s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-75962aab-0d38-4b9e-b4b1-17449b97591a tempest-VolumesListAdminTestJSON-1821048283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7644b1cb-47d5-4d0d-aa16-80585075d511 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:40 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7644b1cb-47d5-4d0d-aa16-80585075d511 Aug 27 03:41:40 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:41 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-75962aab-0d38-4b9e-b4b1-17449b97591a tempest-VolumesListAdminTestJSON-1821048283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7644b1cb-47d5-4d0d-aa16-80585075d511" returned: 0 in 0.452s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-75962aab-0d38-4b9e-b4b1-17449b97591a tempest-VolumesListAdminTestJSON-1821048283 None] Lock "cinder-quobyte-7644b1cb-47d5-4d0d-aa16-80585075d511" released by "delete_volume" :: held 1.267s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:41:41 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=48,cinder:UPDATE=79,cinder:DELETE=9,cinder:INSERT=16 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:41:41 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=55,cinder:UPDATE=72,cinder:INSERT=17,cinder:DELETE=6 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:41:41 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-75962aab-0d38-4b9e-b4b1-17449b97591a tempest-VolumesListAdminTestJSON-1821048283 None] Created reservations ['3e7abfc4-1fe6-4222-bbd4-7ad460fc9edc', '811521b8-412a-44ff-acf0-a04e5c8000d3', '80a4360e-5429-4d32-9747-79bacd60c1f6', '7b6cc682-a0a6-4cd1-bab6-2277144e3e50'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:41:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-75962aab-0d38-4b9e-b4b1-17449b97591a tempest-VolumesListAdminTestJSON-1821048283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:41:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-75962aab-0d38-4b9e-b4b1-17449b97591a tempest-VolumesListAdminTestJSON-1821048283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:41:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-75962aab-0d38-4b9e-b4b1-17449b97591a tempest-VolumesListAdminTestJSON-1821048283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:41:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-75962aab-0d38-4b9e-b4b1-17449b97591a tempest-VolumesListAdminTestJSON-1821048283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:41:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-75962aab-0d38-4b9e-b4b1-17449b97591a tempest-VolumesListAdminTestJSON-1821048283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:41:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-75962aab-0d38-4b9e-b4b1-17449b97591a tempest-VolumesListAdminTestJSON-1821048283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:41 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:41:41 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:41 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-75962aab-0d38-4b9e-b4b1-17449b97591a tempest-VolumesListAdminTestJSON-1821048283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.372s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:41 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-75962aab-0d38-4b9e-b4b1-17449b97591a tempest-VolumesListAdminTestJSON-1821048283 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:41:41 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-75962aab-0d38-4b9e-b4b1-17449b97591a tempest-VolumesListAdminTestJSON-1821048283 None] Deleted volume successfully. Aug 27 03:41:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-75962aab-0d38-4b9e-b4b1-17449b97591a tempest-VolumesListAdminTestJSON-1821048283 None] Lock "cinder-7644b1cb-47d5-4d0d-aa16-80585075d511-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:41:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c3140066-45f4-487f-9a25-0dac604dc466 tempest-VolumesListAdminTestJSON-1821048283 None] Acquiring lock "cinder-88eb7ceb-fdde-438d-abff-af340253f061-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:41:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c3140066-45f4-487f-9a25-0dac604dc466 tempest-VolumesListAdminTestJSON-1821048283 None] Lock "cinder-88eb7ceb-fdde-438d-abff-af340253f061-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:41:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c3140066-45f4-487f-9a25-0dac604dc466 tempest-VolumesListAdminTestJSON-1821048283 None] Acquiring lock "cinder-quobyte-88eb7ceb-fdde-438d-abff-af340253f061" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:41:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c3140066-45f4-487f-9a25-0dac604dc466 tempest-VolumesListAdminTestJSON-1821048283 None] Lock "cinder-quobyte-88eb7ceb-fdde-438d-abff-af340253f061" acquired by "delete_volume" :: waited 0.026s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:41:42 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5e83d0-15f4-425a-81c6-89b475a9de66]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:41:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c3140066-45f4-487f-9a25-0dac604dc466 tempest-VolumesListAdminTestJSON-1821048283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-88eb7ceb-fdde-438d-abff-af340253f061 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:42 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-88eb7ceb-fdde-438d-abff-af340253f061 Aug 27 03:41:42 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:42 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c3140066-45f4-487f-9a25-0dac604dc466 tempest-VolumesListAdminTestJSON-1821048283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-88eb7ceb-fdde-438d-abff-af340253f061" returned: 0 in 0.438s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c3140066-45f4-487f-9a25-0dac604dc466 tempest-VolumesListAdminTestJSON-1821048283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-88eb7ceb-fdde-438d-abff-af340253f061 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:42 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-88eb7ceb-fdde-438d-abff-af340253f061 Aug 27 03:41:42 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:43 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c3140066-45f4-487f-9a25-0dac604dc466 tempest-VolumesListAdminTestJSON-1821048283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-88eb7ceb-fdde-438d-abff-af340253f061" returned: 0 in 0.385s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c3140066-45f4-487f-9a25-0dac604dc466 tempest-VolumesListAdminTestJSON-1821048283 None] Lock "cinder-quobyte-88eb7ceb-fdde-438d-abff-af340253f061" released by "delete_volume" :: held 0.914s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:41:43 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-c3140066-45f4-487f-9a25-0dac604dc466 tempest-VolumesListAdminTestJSON-1821048283 None] Created reservations ['a02938f4-34ab-4cb2-8c79-0e56c30f1b12', 'c4d9a239-43a9-4004-87de-b55d2d3f93e0', '9935dd8e-98f3-4f48-8ce2-36bba7fffd9d', '1c7e40ac-d90e-45ac-bc0c-a68b75eccd56'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:41:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c3140066-45f4-487f-9a25-0dac604dc466 tempest-VolumesListAdminTestJSON-1821048283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:41:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c3140066-45f4-487f-9a25-0dac604dc466 tempest-VolumesListAdminTestJSON-1821048283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:41:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c3140066-45f4-487f-9a25-0dac604dc466 tempest-VolumesListAdminTestJSON-1821048283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:41:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c3140066-45f4-487f-9a25-0dac604dc466 tempest-VolumesListAdminTestJSON-1821048283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:41:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c3140066-45f4-487f-9a25-0dac604dc466 tempest-VolumesListAdminTestJSON-1821048283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:41:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c3140066-45f4-487f-9a25-0dac604dc466 tempest-VolumesListAdminTestJSON-1821048283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:41:43 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:41:43 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:41:43 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Aug 27 03:41:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c3140066-45f4-487f-9a25-0dac604dc466 tempest-VolumesListAdminTestJSON-1821048283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.287s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:41:43 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-c3140066-45f4-487f-9a25-0dac604dc466 tempest-VolumesListAdminTestJSON-1821048283 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:41:43 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-c3140066-45f4-487f-9a25-0dac604dc466 tempest-VolumesListAdminTestJSON-1821048283 None] Deleted volume successfully. Aug 27 03:41:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c3140066-45f4-487f-9a25-0dac604dc466 tempest-VolumesListAdminTestJSON-1821048283 None] Lock "cinder-88eb7ceb-fdde-438d-abff-af340253f061-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:41:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-30b9d2a4-9a65-4bef-94aa-0a43c2682370 req-0f85317c-786d-4c46-b840-332e97c64be9 tempest-TaggedAttachmentsTest-909548316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:41:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-30b9d2a4-9a65-4bef-94aa-0a43c2682370 req-0f85317c-786d-4c46-b840-332e97c64be9 tempest-TaggedAttachmentsTest-909548316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:41:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-30b9d2a4-9a65-4bef-94aa-0a43c2682370 req-0f85317c-786d-4c46-b840-332e97c64be9 tempest-TaggedAttachmentsTest-909548316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:41:47 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-30b9d2a4-9a65-4bef-94aa-0a43c2682370 req-0f85317c-786d-4c46-b840-332e97c64be9 tempest-TaggedAttachmentsTest-909548316 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac', 'name': 'volume-31e40ebc-8c9d-4465-905d-6f0c943f28b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ae55f89-29e3-4150-b1c3-3b56a2473554', 'enforce_multipath': True} {{(pid=94328) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 27 03:41:47 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-30b9d2a4-9a65-4bef-94aa-0a43c2682370 req-0f85317c-786d-4c46-b840-332e97c64be9 tempest-TaggedAttachmentsTest-909548316 None] attachment_update completed successfully. Aug 27 03:41:53 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-1cadc53b-1b87-4ff9-a8af-807410f83f38 req-6940c6a6-6732-47dd-8229-34bb8886f4b5 tempest-TaggedAttachmentsTest-909548316 None] Terminate volume connection completed successfully. Aug 27 03:41:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-1cadc53b-1b87-4ff9-a8af-807410f83f38 req-6940c6a6-6732-47dd-8229-34bb8886f4b5 tempest-TaggedAttachmentsTest-909548316 None] Deleting attachment 3ae55f89-29e3-4150-b1c3-3b56a2473554. {{(pid=94328) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 27 03:42:03 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=16,cinder:INSERT=4,cinder:UPDATE=13,cinder:DELETE=2 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:42:03 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=15,cinder:INSERT=4,cinder:UPDATE=21 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:42:04 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:42:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Flow 'volume_create_manager' (27337723-f8cb-48bc-8cfc-c4e0924bf354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:42:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45223430-9b01-4e45-ab42-8387d1f1259f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45223430-9b01-4e45-ab42-8387d1f1259f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-845076448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc75b660-d838-4e70-aaf7-804203c274b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3825bfb55d7049959c89e0e4fd926940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:42:05Z,use_quota=True,user_id='fa0f1b0acf7b498cb3d0353769c15462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d52ab6-9953-44d7-b210-d9e7b85e44fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d52ab6-9953-44d7-b210-d9e7b85e44fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7298cf1e-8b86-410b-b210-0ee94f4244b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:05 devstack cinder-volume[94328]: DEBUG cinder.image.glance [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Creating Keystone auth plugin from conf {{(pid=94328) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 27 03:42:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7298cf1e-8b86-410b-b210-0ee94f4244b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fc75b660-d838-4e70-aaf7-804203c274b5', 'volume_name': 'volume-fc75b660-d838-4e70-aaf7-804203c274b5', 'volume_size': 1, 'image_id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9b1f4295d504303ad90dfddaa1fb97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'created_at': datetime.datetime(2026, 8, 27, 1, 33, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 33, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f226020c-e698-42bf-8a64-41bbbde77748/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6bdb51-a0db-4c34-a302-28cd4ad198ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6bdb51-a0db-4c34-a302-28cd4ad198ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c952c673-5adc-471c-b864-7a12d5024303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:06 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Volume fc75b660-d838-4e70-aaf7-804203c274b5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fc75b660-d838-4e70-aaf7-804203c274b5', 'volume_size': 1, 'image_id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9b1f4295d504303ad90dfddaa1fb97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'created_at': datetime.datetime(2026, 8, 27, 1, 33, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 33, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f226020c-e698-42bf-8a64-41bbbde77748/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 27 03:42:06 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Trying to clone fc75b660-d838-4e70-aaf7-804203c274b5 from image f226020c-e698-42bf-8a64-41bbbde77748 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}]). {{(pid=94328) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 27 03:42:06 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_xr5gesv5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 27 03:42:06 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Image download 20.69 MB at 20.69 MB/s Aug 27 03:42:06 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcc24d0-ea42-4ce0-8af2-24234c29972f]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:42:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_xr5gesv5devstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:07 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_xr5gesv5devstack@QuobyteHD Aug 27 03:42:07 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:07 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_xr5gesv5devstack@QuobyteHD" returned: 0 in 0.622s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:07 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Temporary image f226020c-e698-42bf-8a64-41bbbde77748 is fetched for user fa0f1b0acf7b498cb3d0353769c15462. {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 27 03:42:07 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9abcc66-94db-44b9-b37d-16e491c0005c]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:42:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_xr5gesv5devstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:07 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_xr5gesv5devstack@QuobyteHD Aug 27 03:42:07 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:08 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_xr5gesv5devstack@QuobyteHD" returned: 0 in 0.702s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:08 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-845076448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc75b660-d838-4e70-aaf7-804203c274b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3825bfb55d7049959c89e0e4fd926940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:42:05Z,use_quota=True,user_id='fa0f1b0acf7b498cb3d0353769c15462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:42:08 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Creating volume fc75b660-d838-4e70-aaf7-804203c274b5 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:42:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:08 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:42:08 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:42:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:08 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:42:08 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:42:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fc75b660-d838-4e70-aaf7-804203c274b5 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:08 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fc75b660-d838-4e70-aaf7-804203c274b5 1073741824 Aug 27 03:42:08 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:09 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fc75b660-d838-4e70-aaf7-804203c274b5 1073741824" returned: 0 in 0.897s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fc75b660-d838-4e70-aaf7-804203c274b5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:09 devstack sudo[99092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fc75b660-d838-4e70-aaf7-804203c274b5 Aug 27 03:42:09 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:10 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fc75b660-d838-4e70-aaf7-804203c274b5" returned: 0 in 0.840s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:42:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:10 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Attempting download of f226020c-e698-42bf-8a64-41bbbde77748 ((None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}])) to volume fc75b660-d838-4e70-aaf7-804203c274b5. {{(pid=94328) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 27 03:42:10 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[083bd7c4-61db-414e-9dfc-dda7a664b620]: (4, 'raw') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:42:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_19boq3jz {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:10 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_19boq3jz Aug 27 03:42:10 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:11 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_19boq3jz" returned: 0 in 0.674s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_19boq3jz {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:11 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_19boq3jz Aug 27 03:42:11 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:11 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_19boq3jz" returned: 1 in 0.408s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_19boq3jz' failed. Not Retrying. {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 27 03:42:11 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0547bc8-c600-49d7-8c2a-393e0cd24eda]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:42:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_xr5gesv5devstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:11 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_xr5gesv5devstack@QuobyteHD Aug 27 03:42:11 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:11 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_xr5gesv5devstack@QuobyteHD" returned: 0 in 0.368s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:11 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] f226020c-e698-42bf-8a64-41bbbde77748 was qcow2, converting to qcow2 {{(pid=94328) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 27 03:42:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_xr5gesv5devstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fc75b660-d838-4e70-aaf7-804203c274b5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:11 devstack sudo[99196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_xr5gesv5devstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fc75b660-d838-4e70-aaf7-804203c274b5 Aug 27 03:42:11 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4d86406c-7484-4883-889c-72491db476e6 tempest-TaggedAttachmentsTest-909548316 None] Acquiring lock "cinder-31e40ebc-8c9d-4465-905d-6f0c943f28b0-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:42:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4d86406c-7484-4883-889c-72491db476e6 tempest-TaggedAttachmentsTest-909548316 None] Lock "cinder-31e40ebc-8c9d-4465-905d-6f0c943f28b0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:42:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4d86406c-7484-4883-889c-72491db476e6 tempest-TaggedAttachmentsTest-909548316 None] Acquiring lock "cinder-quobyte-31e40ebc-8c9d-4465-905d-6f0c943f28b0" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:42:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4d86406c-7484-4883-889c-72491db476e6 tempest-TaggedAttachmentsTest-909548316 None] Lock "cinder-quobyte-31e40ebc-8c9d-4465-905d-6f0c943f28b0" acquired by "delete_volume" :: waited 0.023s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:42:13 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7155a31-ed42-4403-968f-5c356d33e554]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:42:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4d86406c-7484-4883-889c-72491db476e6 tempest-TaggedAttachmentsTest-909548316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-31e40ebc-8c9d-4465-905d-6f0c943f28b0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:13 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-31e40ebc-8c9d-4465-905d-6f0c943f28b0 Aug 27 03:42:13 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:14 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4d86406c-7484-4883-889c-72491db476e6 tempest-TaggedAttachmentsTest-909548316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-31e40ebc-8c9d-4465-905d-6f0c943f28b0" returned: 0 in 0.422s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4d86406c-7484-4883-889c-72491db476e6 tempest-TaggedAttachmentsTest-909548316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-31e40ebc-8c9d-4465-905d-6f0c943f28b0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:14 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-31e40ebc-8c9d-4465-905d-6f0c943f28b0 Aug 27 03:42:14 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:14 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:14 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4d86406c-7484-4883-889c-72491db476e6 tempest-TaggedAttachmentsTest-909548316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-31e40ebc-8c9d-4465-905d-6f0c943f28b0" returned: 0 in 0.333s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_xr5gesv5devstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fc75b660-d838-4e70-aaf7-804203c274b5" returned: 0 in 2.546s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:14 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_xr5gesv5devstack@QuobyteHD, size 112.00 MB, duration 2.55 sec, destination /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fc75b660-d838-4e70-aaf7-804203c274b5 {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:42:14 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Converted 112.00 MB image at 43.97 MB/s Aug 27 03:42:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fc75b660-d838-4e70-aaf7-804203c274b5 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:14 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4d86406c-7484-4883-889c-72491db476e6 tempest-TaggedAttachmentsTest-909548316 None] Lock "cinder-quobyte-31e40ebc-8c9d-4465-905d-6f0c943f28b0" released by "delete_volume" :: held 0.820s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:42:14 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fc75b660-d838-4e70-aaf7-804203c274b5 1G Aug 27 03:42:14 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:14 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-4d86406c-7484-4883-889c-72491db476e6 tempest-TaggedAttachmentsTest-909548316 None] Created reservations ['e9f3f4bf-d495-4570-b00c-cef842bbd845', '68504857-eacd-47ed-be8d-ab6656c820c3', '171ff561-b61f-445e-8a19-a2a30fd7dd23', '02e9911c-4db5-453b-9d98-1b1b35ff50d8'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:42:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4d86406c-7484-4883-889c-72491db476e6 tempest-TaggedAttachmentsTest-909548316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4d86406c-7484-4883-889c-72491db476e6 tempest-TaggedAttachmentsTest-909548316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4d86406c-7484-4883-889c-72491db476e6 tempest-TaggedAttachmentsTest-909548316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:42:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4d86406c-7484-4883-889c-72491db476e6 tempest-TaggedAttachmentsTest-909548316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:42:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4d86406c-7484-4883-889c-72491db476e6 tempest-TaggedAttachmentsTest-909548316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4d86406c-7484-4883-889c-72491db476e6 tempest-TaggedAttachmentsTest-909548316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:14 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:42:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:14 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:42:14 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:42:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:42:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:14 devstack sudo[99223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:42:14 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fc75b660-d838-4e70-aaf7-804203c274b5 1G" returned: 0 in 0.841s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:15 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Downloaded image f226020c-e698-42bf-8a64-41bbbde77748 ((None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}])) to volume fc75b660-d838-4e70-aaf7-804203c274b5 successfully. {{(pid=94328) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 27 03:42:15 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:15 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Temporary image f226020c-e698-42bf-8a64-41bbbde77748 for user fa0f1b0acf7b498cb3d0353769c15462 is deleted. {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 27 03:42:15 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Marking volume fc75b660-d838-4e70-aaf7-804203c274b5 as bootable. {{(pid=94328) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 27 03:42:15 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4d86406c-7484-4883-889c-72491db476e6 tempest-TaggedAttachmentsTest-909548316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.617s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4d86406c-7484-4883-889c-72491db476e6 tempest-TaggedAttachmentsTest-909548316 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:42:15 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-4d86406c-7484-4883-889c-72491db476e6 tempest-TaggedAttachmentsTest-909548316 None] Deleted volume successfully. Aug 27 03:42:15 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Copying metadata from image f226020c-e698-42bf-8a64-41bbbde77748 to fc75b660-d838-4e70-aaf7-804203c274b5. {{(pid=94328) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 27 03:42:15 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Creating volume glance metadata for volume fc75b660-d838-4e70-aaf7-804203c274b5 backed by image f226020c-e698-42bf-8a64-41bbbde77748 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94328) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 27 03:42:15 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.661s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:15 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4d86406c-7484-4883-889c-72491db476e6 tempest-TaggedAttachmentsTest-909548316 None] Lock "cinder-31e40ebc-8c9d-4465-905d-6f0c943f28b0-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:42:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:42:15 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager._thread_info {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:42:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread count: 28 {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 03:42:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread info: [<_MainThread(MainThread, started 134250325188736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 03:42:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c952c673-5adc-471c-b864-7a12d5024303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc75b660-d838-4e70-aaf7-804203c274b5', 'volume_size': 1, 'image_id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9b1f4295d504303ad90dfddaa1fb97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'created_at': datetime.datetime(2026, 8, 27, 1, 33, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 33, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f226020c-e698-42bf-8a64-41bbbde77748/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cbf6384-78dd-4c47-9d88-8363abfe92a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:15 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Volume volume-fc75b660-d838-4e70-aaf7-804203c274b5 (fc75b660-d838-4e70-aaf7-804203c274b5): created successfully Aug 27 03:42:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cbf6384-78dd-4c47-9d88-8363abfe92a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Flow 'volume_create_manager' (27337723-f8cb-48bc-8cfc-c4e0924bf354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:42:15 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-dbe3c49d-b7a4-4a52-a63c-c501a8f31374 tempest-VolumesImageMetadata-908807288 None] Created volume successfully. Aug 27 03:42:17 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b16e13a2-7a5d-49ce-bda4-7e9b760a1953 tempest-VolumesImageMetadata-908807288 None] Acquiring lock "cinder-fc75b660-d838-4e70-aaf7-804203c274b5-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:42:17 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b16e13a2-7a5d-49ce-bda4-7e9b760a1953 tempest-VolumesImageMetadata-908807288 None] Lock "cinder-fc75b660-d838-4e70-aaf7-804203c274b5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:42:17 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b16e13a2-7a5d-49ce-bda4-7e9b760a1953 tempest-VolumesImageMetadata-908807288 None] Acquiring lock "cinder-quobyte-fc75b660-d838-4e70-aaf7-804203c274b5" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:42:17 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b16e13a2-7a5d-49ce-bda4-7e9b760a1953 tempest-VolumesImageMetadata-908807288 None] Lock "cinder-quobyte-fc75b660-d838-4e70-aaf7-804203c274b5" acquired by "delete_volume" :: waited 0.034s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:42:17 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b52466-1fda-4584-a49e-02a2242dd309]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:42:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b16e13a2-7a5d-49ce-bda4-7e9b760a1953 tempest-VolumesImageMetadata-908807288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fc75b660-d838-4e70-aaf7-804203c274b5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:17 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fc75b660-d838-4e70-aaf7-804203c274b5 Aug 27 03:42:17 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:17 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b16e13a2-7a5d-49ce-bda4-7e9b760a1953 tempest-VolumesImageMetadata-908807288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fc75b660-d838-4e70-aaf7-804203c274b5" returned: 0 in 0.558s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b16e13a2-7a5d-49ce-bda4-7e9b760a1953 tempest-VolumesImageMetadata-908807288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fc75b660-d838-4e70-aaf7-804203c274b5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:17 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fc75b660-d838-4e70-aaf7-804203c274b5 Aug 27 03:42:17 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:18 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b16e13a2-7a5d-49ce-bda4-7e9b760a1953 tempest-VolumesImageMetadata-908807288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fc75b660-d838-4e70-aaf7-804203c274b5" returned: 0 in 0.324s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b16e13a2-7a5d-49ce-bda4-7e9b760a1953 tempest-VolumesImageMetadata-908807288 None] Lock "cinder-quobyte-fc75b660-d838-4e70-aaf7-804203c274b5" released by "delete_volume" :: held 0.948s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:42:18 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-b16e13a2-7a5d-49ce-bda4-7e9b760a1953 tempest-VolumesImageMetadata-908807288 None] Created reservations ['83834b44-ce5e-4085-8140-3325863f3cea', 'd7436d12-bc76-417e-8399-a9b13dc54e02', 'ef00ef3a-054a-49c8-ab27-de2714c1fadb', 'f91279a1-e785-48f2-ad20-669c4b65f14d'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:42:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b16e13a2-7a5d-49ce-bda4-7e9b760a1953 tempest-VolumesImageMetadata-908807288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b16e13a2-7a5d-49ce-bda4-7e9b760a1953 tempest-VolumesImageMetadata-908807288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b16e13a2-7a5d-49ce-bda4-7e9b760a1953 tempest-VolumesImageMetadata-908807288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:42:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b16e13a2-7a5d-49ce-bda4-7e9b760a1953 tempest-VolumesImageMetadata-908807288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:42:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b16e13a2-7a5d-49ce-bda4-7e9b760a1953 tempest-VolumesImageMetadata-908807288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b16e13a2-7a5d-49ce-bda4-7e9b760a1953 tempest-VolumesImageMetadata-908807288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:18 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:42:18 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:18 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b16e13a2-7a5d-49ce-bda4-7e9b760a1953 tempest-VolumesImageMetadata-908807288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.291s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:18 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-b16e13a2-7a5d-49ce-bda4-7e9b760a1953 tempest-VolumesImageMetadata-908807288 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:42:18 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-b16e13a2-7a5d-49ce-bda4-7e9b760a1953 tempest-VolumesImageMetadata-908807288 None] Deleted volume successfully. Aug 27 03:42:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b16e13a2-7a5d-49ce-bda4-7e9b760a1953 tempest-VolumesImageMetadata-908807288 None] Lock "cinder-fc75b660-d838-4e70-aaf7-804203c274b5-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:42:19 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:42:19 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Flow 'volume_create_manager' (b2fa557f-8cc5-41ff-9df6-8476b4501a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:42:19 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34b7405-d2ec-46c6-bf32-d9e065cabf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:19 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34b7405-d2ec-46c6-bf32-d9e065cabf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1280895931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ac41f78f73426da5465f9fa5fd5bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:42:20Z,use_quota=True,user_id='a71e750422e341fca444738ad5b3f44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:19 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f136d45-580a-42e0-aca6-bedc7102e504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:19 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f136d45-580a-42e0-aca6-bedc7102e504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:19 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d615ca2-f059-4b4e-8c09-d247927e92d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:19 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d615ca2-f059-4b4e-8c09-d247927e92d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468', 'volume_name': 'volume-9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:19 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (846332d4-b3d3-4dc6-9fb3-c6512792ce57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:19 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (846332d4-b3d3-4dc6-9fb3-c6512792ce57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:19 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db063c86-5524-416f-b16d-a178707aaf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:19 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Volume 9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468', 'volume_size': 1} Aug 27 03:42:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1280895931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ac41f78f73426da5465f9fa5fd5bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:42:20Z,use_quota=True,user_id='a71e750422e341fca444738ad5b3f44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:42:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Creating volume 9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:42:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:42:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:42:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:42:19 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:42:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:19 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468 1073741824 Aug 27 03:42:19 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:20 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468 1073741824" returned: 0 in 0.650s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:20 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468 Aug 27 03:42:20 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:20 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468" returned: 0 in 0.297s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:42:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db063c86-5524-416f-b16d-a178707aaf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acec5b88-3cbe-4ccb-8b68-51fa5dae115e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:20 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Volume volume-9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468 (9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468): created successfully Aug 27 03:42:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acec5b88-3cbe-4ccb-8b68-51fa5dae115e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Flow 'volume_create_manager' (b2fa557f-8cc5-41ff-9df6-8476b4501a69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:42:20 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-861a4877-dc1e-49c3-be66-c027380ffa16 tempest-ServersNegativeTestJSON-746969976 None] Created volume successfully. Aug 27 03:42:22 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:42:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Flow 'volume_create_manager' (20d6baf9-39f9-4f97-9080-3f606025aa29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:42:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce57435-8478-4451-8558-1fe40620773b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce57435-8478-4451-8558-1fe40620773b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1900043160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1361249-56b3-4dec-b9f8-792ea5aa7e24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c488ec61452942209fda2b69875fb435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:42:22Z,use_quota=True,user_id='d7d847d79e974c61a30af5c0f5f01dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f1a767-acb0-4c97-9dd5-35b9ac06eb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f1a767-acb0-4c97-9dd5-35b9ac06eb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9894a1c3-4aa3-4512-b864-b71941e52f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9894a1c3-4aa3-4512-b864-b71941e52f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1361249-56b3-4dec-b9f8-792ea5aa7e24', 'volume_name': 'volume-d1361249-56b3-4dec-b9f8-792ea5aa7e24', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326140e2-2300-480f-9e77-77ed62f5ecb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326140e2-2300-480f-9e77-77ed62f5ecb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7423615-efa7-43db-ab79-393b15759bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:22 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Volume d1361249-56b3-4dec-b9f8-792ea5aa7e24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1361249-56b3-4dec-b9f8-792ea5aa7e24', 'volume_size': 1} Aug 27 03:42:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1900043160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1361249-56b3-4dec-b9f8-792ea5aa7e24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c488ec61452942209fda2b69875fb435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:42:22Z,use_quota=True,user_id='d7d847d79e974c61a30af5c0f5f01dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:42:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Creating volume d1361249-56b3-4dec-b9f8-792ea5aa7e24 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:42:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:42:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:42:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:42:22 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:42:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d1361249-56b3-4dec-b9f8-792ea5aa7e24 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:22 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d1361249-56b3-4dec-b9f8-792ea5aa7e24 1073741824 Aug 27 03:42:22 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:23 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d1361249-56b3-4dec-b9f8-792ea5aa7e24 1073741824" returned: 0 in 0.679s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d1361249-56b3-4dec-b9f8-792ea5aa7e24 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:23 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d1361249-56b3-4dec-b9f8-792ea5aa7e24 Aug 27 03:42:23 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Flow 'volume_create_manager' (ed112679-289d-471d-9201-827b4b769559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21206776-476f-4595-a4bb-2ba42a79f353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21206776-476f-4595-a4bb-2ba42a79f353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2028581991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74387fab-b8f3-4016-8a9c-b6d46cb284ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd8510433c174867ab53deccac5615b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:42:23Z,use_quota=True,user_id='f0839bd057cc45899af934546b6724e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77e6a7d7-1bba-4a0a-9791-6c29ac92e8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77e6a7d7-1bba-4a0a-9791-6c29ac92e8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb34c4a-c2c7-4210-8f22-3e8ab091af22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb34c4a-c2c7-4210-8f22-3e8ab091af22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74387fab-b8f3-4016-8a9c-b6d46cb284ae', 'volume_name': 'volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b012d2f6-faa7-4fcf-9007-6b5449c72928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b012d2f6-faa7-4fcf-9007-6b5449c72928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d2fdea-3f66-4b6f-9bde-d7b918ddba11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:23 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Volume 74387fab-b8f3-4016-8a9c-b6d46cb284ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae', 'volume_size': 1} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:23 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d1361249-56b3-4dec-b9f8-792ea5aa7e24" returned: 0 in 0.305s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.095s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2028581991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74387fab-b8f3-4016-8a9c-b6d46cb284ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd8510433c174867ab53deccac5615b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:42:23Z,use_quota=True,user_id='f0839bd057cc45899af934546b6724e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Creating volume 74387fab-b8f3-4016-8a9c-b6d46cb284ae {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:42:23 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:23 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae 1073741824 Aug 27 03:42:23 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7423615-efa7-43db-ab79-393b15759bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1361249-56b3-4dec-b9f8-792ea5aa7e24', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d4bd54-3861-4f6d-bc18-3e1cf56cc34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:23 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Volume volume-d1361249-56b3-4dec-b9f8-792ea5aa7e24 (d1361249-56b3-4dec-b9f8-792ea5aa7e24): created successfully Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d4bd54-3861-4f6d-bc18-3e1cf56cc34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Flow 'volume_create_manager' (20d6baf9-39f9-4f97-9080-3f606025aa29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:42:23 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d5c39850-8c32-416b-bab0-ca3a1eefee26 tempest-AttachVolumeTestJSON-1763649932 None] Created volume successfully. Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Flow 'volume_create_manager' (d0f78651-48ef-40e5-b20b-bc3109ab6483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae3ead0e-94a1-4962-92ab-f00eb86b6a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae3ead0e-94a1-4962-92ab-f00eb86b6a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-219596613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04119102-b673-49d6-9dfe-b2b35374c8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ac41f78f73426da5465f9fa5fd5bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:42:24Z,use_quota=True,user_id='a71e750422e341fca444738ad5b3f44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb3f0e9-a322-42f0-8714-13e5212af9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb3f0e9-a322-42f0-8714-13e5212af9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e8924e6-7d4c-4a8b-8680-ca75e57d1052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e8924e6-7d4c-4a8b-8680-ca75e57d1052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04119102-b673-49d6-9dfe-b2b35374c8d8', 'volume_name': 'volume-04119102-b673-49d6-9dfe-b2b35374c8d8', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a899f8-5b14-4b31-a4f9-a436c2139b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a899f8-5b14-4b31-a4f9-a436c2139b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (561d49c5-1d8f-4086-9b97-5d2a3006ecb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:23 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Volume 04119102-b673-49d6-9dfe-b2b35374c8d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04119102-b673-49d6-9dfe-b2b35374c8d8', 'volume_size': 1} Aug 27 03:42:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:24 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae 1073741824" returned: 0 in 0.518s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:24 devstack sudo[99312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae Aug 27 03:42:24 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:24 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae" returned: 0 in 0.269s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:42:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.599s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-219596613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04119102-b673-49d6-9dfe-b2b35374c8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ac41f78f73426da5465f9fa5fd5bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:42:24Z,use_quota=True,user_id='a71e750422e341fca444738ad5b3f44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:42:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Creating volume 04119102-b673-49d6-9dfe-b2b35374c8d8 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:42:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:42:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:42:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:42:24 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:42:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04119102-b673-49d6-9dfe-b2b35374c8d8 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:24 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04119102-b673-49d6-9dfe-b2b35374c8d8 1073741824 Aug 27 03:42:24 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d2fdea-3f66-4b6f-9bde-d7b918ddba11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e528a7f4-70fe-4536-9380-65817a2f131a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:24 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Volume volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae (74387fab-b8f3-4016-8a9c-b6d46cb284ae): created successfully Aug 27 03:42:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e528a7f4-70fe-4536-9380-65817a2f131a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Flow 'volume_create_manager' (ed112679-289d-471d-9201-827b4b769559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:42:24 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-051a1159-e81e-41c8-b532-bcd88453ae6a tempest-SnapshotMetadataTestJSON-1454843022 None] Created volume successfully. Aug 27 03:42:24 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04119102-b673-49d6-9dfe-b2b35374c8d8 1073741824" returned: 0 in 0.474s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04119102-b673-49d6-9dfe-b2b35374c8d8 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:25 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04119102-b673-49d6-9dfe-b2b35374c8d8 Aug 27 03:42:25 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-45390de7-3a21-486f-ac97-a8b94aac9b2c req-d230a20e-cf54-466d-a1b0-a77c699c3657 tempest-AttachVolumeTestJSON-1763649932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:25 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04119102-b673-49d6-9dfe-b2b35374c8d8" returned: 0 in 0.314s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:25 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:42:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-45390de7-3a21-486f-ac97-a8b94aac9b2c req-d230a20e-cf54-466d-a1b0-a77c699c3657 tempest-AttachVolumeTestJSON-1763649932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.062s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (561d49c5-1d8f-4086-9b97-5d2a3006ecb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04119102-b673-49d6-9dfe-b2b35374c8d8', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19338b0a-1753-4ea7-ada8-ab8bf2e8010b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-45390de7-3a21-486f-ac97-a8b94aac9b2c req-d230a20e-cf54-466d-a1b0-a77c699c3657 tempest-AttachVolumeTestJSON-1763649932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.064s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:25 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Volume volume-04119102-b673-49d6-9dfe-b2b35374c8d8 (04119102-b673-49d6-9dfe-b2b35374c8d8): created successfully Aug 27 03:42:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19338b0a-1753-4ea7-ada8-ab8bf2e8010b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Flow 'volume_create_manager' (d0f78651-48ef-40e5-b20b-bc3109ab6483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:42:25 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-ff23e4e8-fe01-47fe-9493-51c7f52beddc tempest-ServersNegativeTestJSON-746969976 None] Created volume successfully. Aug 27 03:42:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-45390de7-3a21-486f-ac97-a8b94aac9b2c req-d230a20e-cf54-466d-a1b0-a77c699c3657 tempest-AttachVolumeTestJSON-1763649932 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac', 'name': 'volume-d1361249-56b3-4dec-b9f8-792ea5aa7e24', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68e77f15-bdd2-4dfa-ae37-4cd463050fb5', 'enforce_multipath': True} {{(pid=94328) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 27 03:42:25 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-45390de7-3a21-486f-ac97-a8b94aac9b2c req-d230a20e-cf54-466d-a1b0-a77c699c3657 tempest-AttachVolumeTestJSON-1763649932 None] attachment_update completed successfully. Aug 27 03:42:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1e5faa98-f8b8-4eb1-b3a4-f76063d4c2be tempest-SnapshotMetadataTestJSON-1454843022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1e5faa98-f8b8-4eb1-b3a4-f76063d4c2be tempest-SnapshotMetadataTestJSON-1454843022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:25 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-1e5faa98-f8b8-4eb1-b3a4-f76063d4c2be tempest-SnapshotMetadataTestJSON-1454843022 None] Creating offline snapshot 55619225-c5b6-484a-9bf0-6db03a26d8e7 of volume 74387fab-b8f3-4016-8a9c-b6d46cb284ae {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:42:25 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[996f88bd-030e-4899-8249-af3ff9d7b8c1]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:42:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1e5faa98-f8b8-4eb1-b3a4-f76063d4c2be tempest-SnapshotMetadataTestJSON-1454843022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:25 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae Aug 27 03:42:25 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:26 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1e5faa98-f8b8-4eb1-b3a4-f76063d4c2be tempest-SnapshotMetadataTestJSON-1454843022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae" returned: 0 in 0.495s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1e5faa98-f8b8-4eb1-b3a4-f76063d4c2be tempest-SnapshotMetadataTestJSON-1454843022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.55619225-c5b6-484a-9bf0-6db03a26d8e7 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:26 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.55619225-c5b6-484a-9bf0-6db03a26d8e7 1G Aug 27 03:42:26 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4969d6a0-dbfb-4e26-a462-1d8105fff798 tempest-ServersNegativeTestJSON-746969976 None] Acquiring lock "cinder-04119102-b673-49d6-9dfe-b2b35374c8d8-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:42:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4969d6a0-dbfb-4e26-a462-1d8105fff798 tempest-ServersNegativeTestJSON-746969976 None] Lock "cinder-04119102-b673-49d6-9dfe-b2b35374c8d8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:42:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4969d6a0-dbfb-4e26-a462-1d8105fff798 tempest-ServersNegativeTestJSON-746969976 None] Acquiring lock "cinder-quobyte-04119102-b673-49d6-9dfe-b2b35374c8d8" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:42:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4969d6a0-dbfb-4e26-a462-1d8105fff798 tempest-ServersNegativeTestJSON-746969976 None] Lock "cinder-quobyte-04119102-b673-49d6-9dfe-b2b35374c8d8" acquired by "delete_volume" :: waited 0.032s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:42:26 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a46528-ecb5-435d-bf9a-47c9d1979578]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:42:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4969d6a0-dbfb-4e26-a462-1d8105fff798 tempest-ServersNegativeTestJSON-746969976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04119102-b673-49d6-9dfe-b2b35374c8d8 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:26 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04119102-b673-49d6-9dfe-b2b35374c8d8 Aug 27 03:42:26 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:26 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1e5faa98-f8b8-4eb1-b3a4-f76063d4c2be tempest-SnapshotMetadataTestJSON-1454843022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.55619225-c5b6-484a-9bf0-6db03a26d8e7 1G" returned: 0 in 0.661s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1e5faa98-f8b8-4eb1-b3a4-f76063d4c2be tempest-SnapshotMetadataTestJSON-1454843022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.55619225-c5b6-484a-9bf0-6db03a26d8e7 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:27 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.55619225-c5b6-484a-9bf0-6db03a26d8e7 Aug 27 03:42:27 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:27 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4969d6a0-dbfb-4e26-a462-1d8105fff798 tempest-ServersNegativeTestJSON-746969976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04119102-b673-49d6-9dfe-b2b35374c8d8" returned: 0 in 0.419s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4969d6a0-dbfb-4e26-a462-1d8105fff798 tempest-ServersNegativeTestJSON-746969976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04119102-b673-49d6-9dfe-b2b35374c8d8 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:27 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04119102-b673-49d6-9dfe-b2b35374c8d8 Aug 27 03:42:27 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:27 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1e5faa98-f8b8-4eb1-b3a4-f76063d4c2be tempest-SnapshotMetadataTestJSON-1454843022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.55619225-c5b6-484a-9bf0-6db03a26d8e7" returned: 0 in 0.360s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:27 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-1e5faa98-f8b8-4eb1-b3a4-f76063d4c2be tempest-SnapshotMetadataTestJSON-1454843022 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.55619225-c5b6-484a-9bf0-6db03a26d8e7 is being set with open permissions: ugo+rw Aug 27 03:42:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1e5faa98-f8b8-4eb1-b3a4-f76063d4c2be tempest-SnapshotMetadataTestJSON-1454843022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.55619225-c5b6-484a-9bf0-6db03a26d8e7 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:27 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.55619225-c5b6-484a-9bf0-6db03a26d8e7 Aug 27 03:42:27 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:27 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4969d6a0-dbfb-4e26-a462-1d8105fff798 tempest-ServersNegativeTestJSON-746969976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04119102-b673-49d6-9dfe-b2b35374c8d8" returned: 0 in 0.363s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:27 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4969d6a0-dbfb-4e26-a462-1d8105fff798 tempest-ServersNegativeTestJSON-746969976 None] Lock "cinder-quobyte-04119102-b673-49d6-9dfe-b2b35374c8d8" released by "delete_volume" :: held 0.850s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:42:27 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1e5faa98-f8b8-4eb1-b3a4-f76063d4c2be tempest-SnapshotMetadataTestJSON-1454843022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.55619225-c5b6-484a-9bf0-6db03a26d8e7" returned: 0 in 0.354s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:27 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-4969d6a0-dbfb-4e26-a462-1d8105fff798 tempest-ServersNegativeTestJSON-746969976 None] Created reservations ['8f5ef102-3b79-4e55-9b84-fe20bdc8a017', 'ffae311d-0d0a-4087-b803-11393de16df3', 'c41d2777-cbf5-4cd6-b553-473be963ce7e', '400065c8-2730-4cf9-96ad-726d0e3840f5'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:42:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1e5faa98-f8b8-4eb1-b3a4-f76063d4c2be tempest-SnapshotMetadataTestJSON-1454843022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:27 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.info Aug 27 03:42:27 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4969d6a0-dbfb-4e26-a462-1d8105fff798 tempest-ServersNegativeTestJSON-746969976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4969d6a0-dbfb-4e26-a462-1d8105fff798 tempest-ServersNegativeTestJSON-746969976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4969d6a0-dbfb-4e26-a462-1d8105fff798 tempest-ServersNegativeTestJSON-746969976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:42:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4969d6a0-dbfb-4e26-a462-1d8105fff798 tempest-ServersNegativeTestJSON-746969976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:42:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4969d6a0-dbfb-4e26-a462-1d8105fff798 tempest-ServersNegativeTestJSON-746969976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4969d6a0-dbfb-4e26-a462-1d8105fff798 tempest-ServersNegativeTestJSON-746969976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:27 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:42:27 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-24ae7522-8af4-4dfb-9c82-77f07d1a1fde tempest-ServersNegativeTestJSON-746969976 None] Acquiring lock "cinder-9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-24ae7522-8af4-4dfb-9c82-77f07d1a1fde tempest-ServersNegativeTestJSON-746969976 None] Lock "cinder-9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-24ae7522-8af4-4dfb-9c82-77f07d1a1fde tempest-ServersNegativeTestJSON-746969976 None] Acquiring lock "cinder-quobyte-9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-24ae7522-8af4-4dfb-9c82-77f07d1a1fde tempest-ServersNegativeTestJSON-746969976 None] Lock "cinder-quobyte-9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468" acquired by "delete_volume" :: waited 0.028s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[88164992-155b-46e2-9560-a5b8e0243a68]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ae7522-8af4-4dfb-9c82-77f07d1a1fde tempest-ServersNegativeTestJSON-746969976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:28 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4969d6a0-dbfb-4e26-a462-1d8105fff798 tempest-ServersNegativeTestJSON-746969976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.349s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4969d6a0-dbfb-4e26-a462-1d8105fff798 tempest-ServersNegativeTestJSON-746969976 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:42:28 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-4969d6a0-dbfb-4e26-a462-1d8105fff798 tempest-ServersNegativeTestJSON-746969976 None] Deleted volume successfully. Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4969d6a0-dbfb-4e26-a462-1d8105fff798 tempest-ServersNegativeTestJSON-746969976 None] Lock "cinder-04119102-b673-49d6-9dfe-b2b35374c8d8-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:42:28 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1e5faa98-f8b8-4eb1-b3a4-f76063d4c2be tempest-SnapshotMetadataTestJSON-1454843022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.info" returned: 0 in 0.556s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:28 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-1e5faa98-f8b8-4eb1-b3a4-f76063d4c2be tempest-SnapshotMetadataTestJSON-1454843022 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.info is being set with open permissions: ugo+rw Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1e5faa98-f8b8-4eb1-b3a4-f76063d4c2be tempest-SnapshotMetadataTestJSON-1454843022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:28 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.info Aug 27 03:42:28 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:28 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468 Aug 27 03:42:28 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Flow 'volume_create_manager' (43a340c1-5736-46ee-b74d-e8a12778bd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87035113-937f-4a4a-a927-170da9039fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87035113-937f-4a4a-a927-170da9039fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-55740513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24574821-e444-4ad0-98e3-4a9f483ea7c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c488ec61452942209fda2b69875fb435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:42:28Z,use_quota=True,user_id='d7d847d79e974c61a30af5c0f5f01dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cea3f94-9b66-40b2-81a3-3c226d3c8cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cea3f94-9b66-40b2-81a3-3c226d3c8cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996b7444-e240-4bf9-bcc4-dd25f0c602f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996b7444-e240-4bf9-bcc4-dd25f0c602f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24574821-e444-4ad0-98e3-4a9f483ea7c3', 'volume_name': 'volume-24574821-e444-4ad0-98e3-4a9f483ea7c3', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d948355e-b306-4da2-9a3d-027cb2db6e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d948355e-b306-4da2-9a3d-027cb2db6e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012005f4-8a40-4101-8347-e37d69397b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:28 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Volume 24574821-e444-4ad0-98e3-4a9f483ea7c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24574821-e444-4ad0-98e3-4a9f483ea7c3', 'volume_size': 1} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:28 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1e5faa98-f8b8-4eb1-b3a4-f76063d4c2be tempest-SnapshotMetadataTestJSON-1454843022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.info" returned: 0 in 0.289s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1e5faa98-f8b8-4eb1-b3a4-f76063d4c2be tempest-SnapshotMetadataTestJSON-1454843022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.873s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.149s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-55740513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24574821-e444-4ad0-98e3-4a9f483ea7c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c488ec61452942209fda2b69875fb435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:42:28Z,use_quota=True,user_id='d7d847d79e974c61a30af5c0f5f01dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Creating volume 24574821-e444-4ad0-98e3-4a9f483ea7c3 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:42:28 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-24574821-e444-4ad0-98e3-4a9f483ea7c3 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:28 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-24574821-e444-4ad0-98e3-4a9f483ea7c3 1073741824 Aug 27 03:42:28 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:28 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ae7522-8af4-4dfb-9c82-77f07d1a1fde tempest-ServersNegativeTestJSON-746969976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468" returned: 0 in 0.494s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ae7522-8af4-4dfb-9c82-77f07d1a1fde tempest-ServersNegativeTestJSON-746969976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:28 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-1e5faa98-f8b8-4eb1-b3a4-f76063d4c2be tempest-SnapshotMetadataTestJSON-1454843022 None] Create snapshot completed successfully Aug 27 03:42:28 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468 Aug 27 03:42:28 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:28 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ae7522-8af4-4dfb-9c82-77f07d1a1fde tempest-ServersNegativeTestJSON-746969976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468" returned: 0 in 0.323s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-24ae7522-8af4-4dfb-9c82-77f07d1a1fde tempest-ServersNegativeTestJSON-746969976 None] Lock "cinder-quobyte-9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468" released by "delete_volume" :: held 0.893s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-24ae7522-8af4-4dfb-9c82-77f07d1a1fde tempest-ServersNegativeTestJSON-746969976 None] Created reservations ['1a3133fd-3622-4a65-a10f-00ed904f85cb', 'df2fc35e-d813-4279-87b4-e25ecdf1b016', '97db59e2-9a71-4b75-8e9e-e4a016ebb832', '02ab51a5-9352-4292-b22d-8ee189298a2c'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:42:29 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-24574821-e444-4ad0-98e3-4a9f483ea7c3 1073741824" returned: 0 in 0.613s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-24ae7522-8af4-4dfb-9c82-77f07d1a1fde tempest-ServersNegativeTestJSON-746969976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-24ae7522-8af4-4dfb-9c82-77f07d1a1fde tempest-ServersNegativeTestJSON-746969976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-24ae7522-8af4-4dfb-9c82-77f07d1a1fde tempest-ServersNegativeTestJSON-746969976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-24ae7522-8af4-4dfb-9c82-77f07d1a1fde tempest-ServersNegativeTestJSON-746969976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-24ae7522-8af4-4dfb-9c82-77f07d1a1fde tempest-ServersNegativeTestJSON-746969976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ae7522-8af4-4dfb-9c82-77f07d1a1fde tempest-ServersNegativeTestJSON-746969976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:29 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:42:29 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-24574821-e444-4ad0-98e3-4a9f483ea7c3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:29 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-24574821-e444-4ad0-98e3-4a9f483ea7c3 Aug 27 03:42:29 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:29 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ae7522-8af4-4dfb-9c82-77f07d1a1fde tempest-ServersNegativeTestJSON-746969976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.362s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-24ae7522-8af4-4dfb-9c82-77f07d1a1fde tempest-ServersNegativeTestJSON-746969976 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:42:29 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-24ae7522-8af4-4dfb-9c82-77f07d1a1fde tempest-ServersNegativeTestJSON-746969976 None] Deleted volume successfully. Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-24ae7522-8af4-4dfb-9c82-77f07d1a1fde tempest-ServersNegativeTestJSON-746969976 None] Lock "cinder-9ef7b692-7ee8-4cc6-aa0b-e3ffe0381468-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:42:29 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-24574821-e444-4ad0-98e3-4a9f483ea7c3" returned: 0 in 0.374s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012005f4-8a40-4101-8347-e37d69397b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24574821-e444-4ad0-98e3-4a9f483ea7c3', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4420a754-a97d-4826-8dfe-7ab444ff29e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:29 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Volume volume-24574821-e444-4ad0-98e3-4a9f483ea7c3 (24574821-e444-4ad0-98e3-4a9f483ea7c3): created successfully Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4420a754-a97d-4826-8dfe-7ab444ff29e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Flow 'volume_create_manager' (43a340c1-5736-46ee-b74d-e8a12778bd90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:42:29 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-dac21b8e-5e98-480a-930e-985540d39f68 tempest-AttachVolumeTestJSON-1763649932 None] Created volume successfully. Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4f6d725b-743b-4449-82dc-ba69dde3e71d tempest-SnapshotMetadataTestJSON-1454843022 None] Acquiring lock "cinder-55619225-c5b6-484a-9bf0-6db03a26d8e7-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4f6d725b-743b-4449-82dc-ba69dde3e71d tempest-SnapshotMetadataTestJSON-1454843022 None] Lock "cinder-55619225-c5b6-484a-9bf0-6db03a26d8e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4f6d725b-743b-4449-82dc-ba69dde3e71d tempest-SnapshotMetadataTestJSON-1454843022 None] Acquiring lock "cinder-quobyte-74387fab-b8f3-4016-8a9c-b6d46cb284ae" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4f6d725b-743b-4449-82dc-ba69dde3e71d tempest-SnapshotMetadataTestJSON-1454843022 None] Lock "cinder-quobyte-74387fab-b8f3-4016-8a9c-b6d46cb284ae" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4f6d725b-743b-4449-82dc-ba69dde3e71d tempest-SnapshotMetadataTestJSON-1454843022 None] Acquiring lock "cinder-quobyte-55619225-c5b6-484a-9bf0-6db03a26d8e7" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4f6d725b-743b-4449-82dc-ba69dde3e71d tempest-SnapshotMetadataTestJSON-1454843022 None] Lock "cinder-quobyte-55619225-c5b6-484a-9bf0-6db03a26d8e7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-4f6d725b-743b-4449-82dc-ba69dde3e71d tempest-SnapshotMetadataTestJSON-1454843022 None] Deleting offline snapshot 55619225-c5b6-484a-9bf0-6db03a26d8e7 of volume 74387fab-b8f3-4016-8a9c-b6d46cb284ae {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-4f6d725b-743b-4449-82dc-ba69dde3e71d tempest-SnapshotMetadataTestJSON-1454843022 None] snapshot_file for this snap is: volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.55619225-c5b6-484a-9bf0-6db03a26d8e7 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[40790544-44b1-4772-91ef-e3e0802bc66e]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:42:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4f6d725b-743b-4449-82dc-ba69dde3e71d tempest-SnapshotMetadataTestJSON-1454843022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.55619225-c5b6-484a-9bf0-6db03a26d8e7 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:30 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.55619225-c5b6-484a-9bf0-6db03a26d8e7 Aug 27 03:42:30 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:30 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4f6d725b-743b-4449-82dc-ba69dde3e71d tempest-SnapshotMetadataTestJSON-1454843022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.55619225-c5b6-484a-9bf0-6db03a26d8e7" returned: 0 in 0.403s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-4f6d725b-743b-4449-82dc-ba69dde3e71d tempest-SnapshotMetadataTestJSON-1454843022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:42:30 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[2631da7a-2e31-4f29-8086-23d1a59ed29e]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:42:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4f6d725b-743b-4449-82dc-ba69dde3e71d tempest-SnapshotMetadataTestJSON-1454843022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:30 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae Aug 27 03:42:30 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:31 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4f6d725b-743b-4449-82dc-ba69dde3e71d tempest-SnapshotMetadataTestJSON-1454843022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae" returned: 0 in 0.615s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4f6d725b-743b-4449-82dc-ba69dde3e71d tempest-SnapshotMetadataTestJSON-1454843022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.55619225-c5b6-484a-9bf0-6db03a26d8e7 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:31 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.55619225-c5b6-484a-9bf0-6db03a26d8e7 Aug 27 03:42:31 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:31 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4f6d725b-743b-4449-82dc-ba69dde3e71d tempest-SnapshotMetadataTestJSON-1454843022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.55619225-c5b6-484a-9bf0-6db03a26d8e7" returned: 0 in 0.593s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4f6d725b-743b-4449-82dc-ba69dde3e71d tempest-SnapshotMetadataTestJSON-1454843022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.55619225-c5b6-484a-9bf0-6db03a26d8e7 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-e77496f8-924e-4e1d-b9db-865f2144319e req-8c807d3b-0a1a-4d27-9889-d2cfdd0c3f1b tempest-AttachVolumeTestJSON-1763649932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-e77496f8-924e-4e1d-b9db-865f2144319e req-8c807d3b-0a1a-4d27-9889-d2cfdd0c3f1b tempest-AttachVolumeTestJSON-1763649932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:31 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.55619225-c5b6-484a-9bf0-6db03a26d8e7 Aug 27 03:42:31 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-e77496f8-924e-4e1d-b9db-865f2144319e req-8c807d3b-0a1a-4d27-9889-d2cfdd0c3f1b tempest-AttachVolumeTestJSON-1763649932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-e77496f8-924e-4e1d-b9db-865f2144319e req-8c807d3b-0a1a-4d27-9889-d2cfdd0c3f1b tempest-AttachVolumeTestJSON-1763649932 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac', 'name': 'volume-24574821-e444-4ad0-98e3-4a9f483ea7c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da11a476-3232-42bc-bcd9-319380760f2e', 'enforce_multipath': True} {{(pid=94328) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 27 03:42:31 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-e77496f8-924e-4e1d-b9db-865f2144319e req-8c807d3b-0a1a-4d27-9889-d2cfdd0c3f1b tempest-AttachVolumeTestJSON-1763649932 None] attachment_update completed successfully. Aug 27 03:42:32 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4f6d725b-743b-4449-82dc-ba69dde3e71d tempest-SnapshotMetadataTestJSON-1454843022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae.55619225-c5b6-484a-9bf0-6db03a26d8e7" returned: 0 in 0.375s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4f6d725b-743b-4449-82dc-ba69dde3e71d tempest-SnapshotMetadataTestJSON-1454843022 None] Lock "cinder-quobyte-55619225-c5b6-484a-9bf0-6db03a26d8e7" released by "_delete_snapshot" :: held 2.155s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:42:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4f6d725b-743b-4449-82dc-ba69dde3e71d tempest-SnapshotMetadataTestJSON-1454843022 None] Lock "cinder-quobyte-74387fab-b8f3-4016-8a9c-b6d46cb284ae" released by "delete_snapshot" :: held 2.186s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:42:32 devstack cinder-volume[94328]: WARNING cinder.quota [None req-4f6d725b-743b-4449-82dc-ba69dde3e71d tempest-SnapshotMetadataTestJSON-1454843022 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:42:32 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-4f6d725b-743b-4449-82dc-ba69dde3e71d tempest-SnapshotMetadataTestJSON-1454843022 None] Created reservations ['be105cd4-f9ad-48cd-833c-fbe778bd21b2', 'ac866c62-3f02-43a9-853e-fa438914170d', '84f3bee5-3c8c-4726-bcef-d167ee05c367', '84889fdc-3237-4777-809c-71f4a8a9f585'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:42:32 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-4f6d725b-743b-4449-82dc-ba69dde3e71d tempest-SnapshotMetadataTestJSON-1454843022 None] Delete snapshot completed successfully. Aug 27 03:42:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4f6d725b-743b-4449-82dc-ba69dde3e71d tempest-SnapshotMetadataTestJSON-1454843022 None] Lock "cinder-55619225-c5b6-484a-9bf0-6db03a26d8e7-delete_snapshot" released by "delete_snapshot" :: held 2.407s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:42:33 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c18fcecf-a744-47a1-8449-3917ecfe43de tempest-SnapshotMetadataTestJSON-1454843022 None] Acquiring lock "cinder-74387fab-b8f3-4016-8a9c-b6d46cb284ae-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:42:33 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c18fcecf-a744-47a1-8449-3917ecfe43de tempest-SnapshotMetadataTestJSON-1454843022 None] Lock "cinder-74387fab-b8f3-4016-8a9c-b6d46cb284ae-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:42:33 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c18fcecf-a744-47a1-8449-3917ecfe43de tempest-SnapshotMetadataTestJSON-1454843022 None] Acquiring lock "cinder-quobyte-74387fab-b8f3-4016-8a9c-b6d46cb284ae" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:42:33 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c18fcecf-a744-47a1-8449-3917ecfe43de tempest-SnapshotMetadataTestJSON-1454843022 None] Lock "cinder-quobyte-74387fab-b8f3-4016-8a9c-b6d46cb284ae" acquired by "delete_volume" :: waited 0.024s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:42:33 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[281bade1-f478-47af-b6bf-4b59616432f8]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:42:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c18fcecf-a744-47a1-8449-3917ecfe43de tempest-SnapshotMetadataTestJSON-1454843022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:33 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae Aug 27 03:42:33 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:33 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c18fcecf-a744-47a1-8449-3917ecfe43de tempest-SnapshotMetadataTestJSON-1454843022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae" returned: 0 in 0.463s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c18fcecf-a744-47a1-8449-3917ecfe43de tempest-SnapshotMetadataTestJSON-1454843022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:33 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae Aug 27 03:42:33 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:34 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c18fcecf-a744-47a1-8449-3917ecfe43de tempest-SnapshotMetadataTestJSON-1454843022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-74387fab-b8f3-4016-8a9c-b6d46cb284ae" returned: 0 in 0.372s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c18fcecf-a744-47a1-8449-3917ecfe43de tempest-SnapshotMetadataTestJSON-1454843022 None] Lock "cinder-quobyte-74387fab-b8f3-4016-8a9c-b6d46cb284ae" released by "delete_volume" :: held 0.925s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:42:34 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-c18fcecf-a744-47a1-8449-3917ecfe43de tempest-SnapshotMetadataTestJSON-1454843022 None] Created reservations ['5f96cfba-7e80-4f13-a795-c06a3c7dc976', '60d8834e-0c1b-4927-b9ee-2b08cda25a32', '5379c135-0f25-4ade-a6b7-3fbcc1422128', '57d7e23b-7c36-4d7e-8862-2de3b6909bd5'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:42:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c18fcecf-a744-47a1-8449-3917ecfe43de tempest-SnapshotMetadataTestJSON-1454843022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c18fcecf-a744-47a1-8449-3917ecfe43de tempest-SnapshotMetadataTestJSON-1454843022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c18fcecf-a744-47a1-8449-3917ecfe43de tempest-SnapshotMetadataTestJSON-1454843022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:42:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c18fcecf-a744-47a1-8449-3917ecfe43de tempest-SnapshotMetadataTestJSON-1454843022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:42:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c18fcecf-a744-47a1-8449-3917ecfe43de tempest-SnapshotMetadataTestJSON-1454843022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c18fcecf-a744-47a1-8449-3917ecfe43de tempest-SnapshotMetadataTestJSON-1454843022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:34 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:42:34 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:34 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c18fcecf-a744-47a1-8449-3917ecfe43de tempest-SnapshotMetadataTestJSON-1454843022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.288s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:34 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-c18fcecf-a744-47a1-8449-3917ecfe43de tempest-SnapshotMetadataTestJSON-1454843022 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:42:34 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-c18fcecf-a744-47a1-8449-3917ecfe43de tempest-SnapshotMetadataTestJSON-1454843022 None] Deleted volume successfully. Aug 27 03:42:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c18fcecf-a744-47a1-8449-3917ecfe43de tempest-SnapshotMetadataTestJSON-1454843022 None] Lock "cinder-74387fab-b8f3-4016-8a9c-b6d46cb284ae-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:42:34 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-b33418f6-e9b2-46c9-9269-813107a79392 req-0f360b09-d6d0-400c-8b0d-6072f23b16c1 tempest-AttachVolumeTestJSON-1763649932 None] Terminate volume connection completed successfully. Aug 27 03:42:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-b33418f6-e9b2-46c9-9269-813107a79392 req-0f360b09-d6d0-400c-8b0d-6072f23b16c1 tempest-AttachVolumeTestJSON-1763649932 None] Deleting attachment 68e77f15-bdd2-4dfa-ae37-4cd463050fb5. {{(pid=94328) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 27 03:42:36 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-1bc35bd5-bf6d-4ec1-8a8f-68c516d35a75 req-7c6f51d3-ddcc-4d9e-8fd6-4c9ed922374b tempest-AttachVolumeTestJSON-1763649932 None] Terminate volume connection completed successfully. Aug 27 03:42:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-1bc35bd5-bf6d-4ec1-8a8f-68c516d35a75 req-7c6f51d3-ddcc-4d9e-8fd6-4c9ed922374b tempest-AttachVolumeTestJSON-1763649932 None] Deleting attachment da11a476-3232-42bc-bcd9-319380760f2e. {{(pid=94328) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 27 03:42:42 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:42:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Flow 'volume_create_manager' (e90e1a49-e772-4d30-84aa-0b49d8a5abda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:42:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f5e6a5e-dbd7-49a0-b071-a4da0cff6653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f5e6a5e-dbd7-49a0-b071-a4da0cff6653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1158997524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ca61918-59eb-4a2f-bdec-cbb3972d7253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5529cb6897ce44a2b9718d191376a9d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:42:42Z,use_quota=True,user_id='2846374201294fccbdf2f42d05e62271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35042e26-bce8-474a-8c5a-183477c5b1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35042e26-bce8-474a-8c5a-183477c5b1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971279e4-737f-4bb2-ab7e-7df6257d4e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971279e4-737f-4bb2-ab7e-7df6257d4e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ca61918-59eb-4a2f-bdec-cbb3972d7253', 'volume_name': 'volume-5ca61918-59eb-4a2f-bdec-cbb3972d7253', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a34b515-9bd6-4053-92e9-357115df3c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a34b515-9bd6-4053-92e9-357115df3c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af959cac-2f12-4cb7-9f0a-18f95c6ef44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:42 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Volume 5ca61918-59eb-4a2f-bdec-cbb3972d7253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ca61918-59eb-4a2f-bdec-cbb3972d7253', 'volume_size': 1} Aug 27 03:42:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:42 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1158997524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ca61918-59eb-4a2f-bdec-cbb3972d7253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5529cb6897ce44a2b9718d191376a9d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:42:42Z,use_quota=True,user_id='2846374201294fccbdf2f42d05e62271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:42:42 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Creating volume 5ca61918-59eb-4a2f-bdec-cbb3972d7253 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:42:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:42 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:42:42 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:42:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:42 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:42:42 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:42:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5ca61918-59eb-4a2f-bdec-cbb3972d7253 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:42 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5ca61918-59eb-4a2f-bdec-cbb3972d7253 1073741824 Aug 27 03:42:42 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:42 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5ca61918-59eb-4a2f-bdec-cbb3972d7253 1073741824" returned: 0 in 0.606s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5ca61918-59eb-4a2f-bdec-cbb3972d7253 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:42 devstack sudo[99933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5ca61918-59eb-4a2f-bdec-cbb3972d7253 Aug 27 03:42:42 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:43 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5ca61918-59eb-4a2f-bdec-cbb3972d7253" returned: 0 in 0.316s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:42:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af959cac-2f12-4cb7-9f0a-18f95c6ef44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ca61918-59eb-4a2f-bdec-cbb3972d7253', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9b1173-5b06-410f-b84c-09b5b2238f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:43 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Volume volume-5ca61918-59eb-4a2f-bdec-cbb3972d7253 (5ca61918-59eb-4a2f-bdec-cbb3972d7253): created successfully Aug 27 03:42:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9b1173-5b06-410f-b84c-09b5b2238f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Flow 'volume_create_manager' (e90e1a49-e772-4d30-84aa-0b49d8a5abda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:42:43 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-2a579a75-368f-4918-82cf-5a84d9e7553d tempest-VolumesTransfersV355Test-32060908 None] Created volume successfully. Aug 27 03:42:45 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-c34f5ef5-afe8-4a1c-abf6-4db59a49c224 tempest-VolumesTransfersV355Test-1131153044 None] Transfer volume completed successfully. Aug 27 03:42:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-27eb6b7e-db8c-4864-840f-b633d93d7837 tempest-VolumesTransfersV355Test-1471642052 None] Acquiring lock "cinder-5ca61918-59eb-4a2f-bdec-cbb3972d7253-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:42:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-27eb6b7e-db8c-4864-840f-b633d93d7837 tempest-VolumesTransfersV355Test-1471642052 None] Lock "cinder-5ca61918-59eb-4a2f-bdec-cbb3972d7253-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:42:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-27eb6b7e-db8c-4864-840f-b633d93d7837 tempest-VolumesTransfersV355Test-1471642052 None] Acquiring lock "cinder-quobyte-5ca61918-59eb-4a2f-bdec-cbb3972d7253" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:42:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-27eb6b7e-db8c-4864-840f-b633d93d7837 tempest-VolumesTransfersV355Test-1471642052 None] Lock "cinder-quobyte-5ca61918-59eb-4a2f-bdec-cbb3972d7253" acquired by "delete_volume" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:42:45 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9069093-ec27-4920-80bf-3db48eb45ad9]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:42:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-27eb6b7e-db8c-4864-840f-b633d93d7837 tempest-VolumesTransfersV355Test-1471642052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5ca61918-59eb-4a2f-bdec-cbb3972d7253 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:46 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5ca61918-59eb-4a2f-bdec-cbb3972d7253 Aug 27 03:42:46 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:46 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-27eb6b7e-db8c-4864-840f-b633d93d7837 tempest-VolumesTransfersV355Test-1471642052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5ca61918-59eb-4a2f-bdec-cbb3972d7253" returned: 0 in 0.537s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-27eb6b7e-db8c-4864-840f-b633d93d7837 tempest-VolumesTransfersV355Test-1471642052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5ca61918-59eb-4a2f-bdec-cbb3972d7253 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:46 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5ca61918-59eb-4a2f-bdec-cbb3972d7253 Aug 27 03:42:46 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:46 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-27eb6b7e-db8c-4864-840f-b633d93d7837 tempest-VolumesTransfersV355Test-1471642052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5ca61918-59eb-4a2f-bdec-cbb3972d7253" returned: 0 in 0.324s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:46 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-27eb6b7e-db8c-4864-840f-b633d93d7837 tempest-VolumesTransfersV355Test-1471642052 None] Lock "cinder-quobyte-5ca61918-59eb-4a2f-bdec-cbb3972d7253" released by "delete_volume" :: held 0.920s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:42:46 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-27eb6b7e-db8c-4864-840f-b633d93d7837 tempest-VolumesTransfersV355Test-1471642052 None] Created reservations ['53854e9d-d68c-4c80-b67c-f8138e8f3dc4', 'dd88067c-0b60-466a-90a1-9c575aed028e', '7861b335-0738-484e-937f-d696b3b8d0c7', 'dc4c16af-44a4-4b42-a862-090391f87d26'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:42:46 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b1e9de5e-c8d4-4626-b6ce-8acdf7ab83e5 tempest-AttachVolumeTestJSON-1763649932 None] Acquiring lock "cinder-24574821-e444-4ad0-98e3-4a9f483ea7c3-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:42:46 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b1e9de5e-c8d4-4626-b6ce-8acdf7ab83e5 tempest-AttachVolumeTestJSON-1763649932 None] Lock "cinder-24574821-e444-4ad0-98e3-4a9f483ea7c3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-27eb6b7e-db8c-4864-840f-b633d93d7837 tempest-VolumesTransfersV355Test-1471642052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-27eb6b7e-db8c-4864-840f-b633d93d7837 tempest-VolumesTransfersV355Test-1471642052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-27eb6b7e-db8c-4864-840f-b633d93d7837 tempest-VolumesTransfersV355Test-1471642052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-27eb6b7e-db8c-4864-840f-b633d93d7837 tempest-VolumesTransfersV355Test-1471642052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-27eb6b7e-db8c-4864-840f-b633d93d7837 tempest-VolumesTransfersV355Test-1471642052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-27eb6b7e-db8c-4864-840f-b633d93d7837 tempest-VolumesTransfersV355Test-1471642052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b1e9de5e-c8d4-4626-b6ce-8acdf7ab83e5 tempest-AttachVolumeTestJSON-1763649932 None] Acquiring lock "cinder-quobyte-24574821-e444-4ad0-98e3-4a9f483ea7c3" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b1e9de5e-c8d4-4626-b6ce-8acdf7ab83e5 tempest-AttachVolumeTestJSON-1763649932 None] Lock "cinder-quobyte-24574821-e444-4ad0-98e3-4a9f483ea7c3" acquired by "delete_volume" :: waited 0.023s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:42:47 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:42:47 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0ce3d2-b7b7-4e26-9348-79892c7826ff]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b1e9de5e-c8d4-4626-b6ce-8acdf7ab83e5 tempest-AttachVolumeTestJSON-1763649932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-24574821-e444-4ad0-98e3-4a9f483ea7c3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:47 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-24574821-e444-4ad0-98e3-4a9f483ea7c3 Aug 27 03:42:47 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:47 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-27eb6b7e-db8c-4864-840f-b633d93d7837 tempest-VolumesTransfersV355Test-1471642052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.458s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-27eb6b7e-db8c-4864-840f-b633d93d7837 tempest-VolumesTransfersV355Test-1471642052 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:42:47 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-27eb6b7e-db8c-4864-840f-b633d93d7837 tempest-VolumesTransfersV355Test-1471642052 None] Deleted volume successfully. Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-27eb6b7e-db8c-4864-840f-b633d93d7837 tempest-VolumesTransfersV355Test-1471642052 None] Lock "cinder-5ca61918-59eb-4a2f-bdec-cbb3972d7253-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:42:47 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b1e9de5e-c8d4-4626-b6ce-8acdf7ab83e5 tempest-AttachVolumeTestJSON-1763649932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-24574821-e444-4ad0-98e3-4a9f483ea7c3" returned: 0 in 0.524s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b1e9de5e-c8d4-4626-b6ce-8acdf7ab83e5 tempest-AttachVolumeTestJSON-1763649932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-24574821-e444-4ad0-98e3-4a9f483ea7c3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:47 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-24574821-e444-4ad0-98e3-4a9f483ea7c3 Aug 27 03:42:47 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Flow 'volume_create_manager' (50d41f89-97b2-4134-ba3c-c06967b01771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe856bc-edd6-4f06-863b-7b795c8d23eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe856bc-edd6-4f06-863b-7b795c8d23eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1751838891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78e37b2-3ca2-4231-a652-51a909e409b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5529cb6897ce44a2b9718d191376a9d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:42:48Z,use_quota=True,user_id='2846374201294fccbdf2f42d05e62271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b46755-3b5c-4aa7-a871-e79467fb2c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:47 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b46755-3b5c-4aa7-a871-e79467fb2c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54073292-a97d-4a79-8c38-91ae17df3405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54073292-a97d-4a79-8c38-91ae17df3405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c78e37b2-3ca2-4231-a652-51a909e409b4', 'volume_name': 'volume-c78e37b2-3ca2-4231-a652-51a909e409b4', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (467a861f-b813-4511-b9f3-62f0b427b14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (467a861f-b813-4511-b9f3-62f0b427b14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3af5820-f369-487d-b8ec-efa0a8b5a78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:47 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Volume c78e37b2-3ca2-4231-a652-51a909e409b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c78e37b2-3ca2-4231-a652-51a909e409b4', 'volume_size': 1} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1751838891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78e37b2-3ca2-4231-a652-51a909e409b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5529cb6897ce44a2b9718d191376a9d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:42:48Z,use_quota=True,user_id='2846374201294fccbdf2f42d05e62271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Creating volume c78e37b2-3ca2-4231-a652-51a909e409b4 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:47 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:42:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:42:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:42:48 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:42:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c78e37b2-3ca2-4231-a652-51a909e409b4 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b1e9de5e-c8d4-4626-b6ce-8acdf7ab83e5 tempest-AttachVolumeTestJSON-1763649932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-24574821-e444-4ad0-98e3-4a9f483ea7c3" returned: 0 in 0.370s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:48 devstack sudo[99959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c78e37b2-3ca2-4231-a652-51a909e409b4 1073741824 Aug 27 03:42:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b1e9de5e-c8d4-4626-b6ce-8acdf7ab83e5 tempest-AttachVolumeTestJSON-1763649932 None] Lock "cinder-quobyte-24574821-e444-4ad0-98e3-4a9f483ea7c3" released by "delete_volume" :: held 0.961s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:42:48 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:48 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-b1e9de5e-c8d4-4626-b6ce-8acdf7ab83e5 tempest-AttachVolumeTestJSON-1763649932 None] Created reservations ['595223ff-555e-4886-a1b7-9fa670358f76', 'd969bf29-685b-41a6-a782-0e8bf53b296e', '108bc3c5-49c2-477a-8bb2-abe560054f43', '12da0271-7231-4325-9d6b-f3e73d23bd8f'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:42:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b1e9de5e-c8d4-4626-b6ce-8acdf7ab83e5 tempest-AttachVolumeTestJSON-1763649932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b1e9de5e-c8d4-4626-b6ce-8acdf7ab83e5 tempest-AttachVolumeTestJSON-1763649932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b1e9de5e-c8d4-4626-b6ce-8acdf7ab83e5 tempest-AttachVolumeTestJSON-1763649932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:42:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b1e9de5e-c8d4-4626-b6ce-8acdf7ab83e5 tempest-AttachVolumeTestJSON-1763649932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:42:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b1e9de5e-c8d4-4626-b6ce-8acdf7ab83e5 tempest-AttachVolumeTestJSON-1763649932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b1e9de5e-c8d4-4626-b6ce-8acdf7ab83e5 tempest-AttachVolumeTestJSON-1763649932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:48 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:42:48 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:48 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b1e9de5e-c8d4-4626-b6ce-8acdf7ab83e5 tempest-AttachVolumeTestJSON-1763649932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.339s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:48 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-b1e9de5e-c8d4-4626-b6ce-8acdf7ab83e5 tempest-AttachVolumeTestJSON-1763649932 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:42:48 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-b1e9de5e-c8d4-4626-b6ce-8acdf7ab83e5 tempest-AttachVolumeTestJSON-1763649932 None] Deleted volume successfully. Aug 27 03:42:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b1e9de5e-c8d4-4626-b6ce-8acdf7ab83e5 tempest-AttachVolumeTestJSON-1763649932 None] Lock "cinder-24574821-e444-4ad0-98e3-4a9f483ea7c3-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:42:48 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c78e37b2-3ca2-4231-a652-51a909e409b4 1073741824" returned: 0 in 0.633s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c78e37b2-3ca2-4231-a652-51a909e409b4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:48 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c78e37b2-3ca2-4231-a652-51a909e409b4 Aug 27 03:42:48 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:48 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c78e37b2-3ca2-4231-a652-51a909e409b4" returned: 0 in 0.313s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:42:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3af5820-f369-487d-b8ec-efa0a8b5a78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c78e37b2-3ca2-4231-a652-51a909e409b4', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46fdbe45-1475-4a1e-b253-e0a15d3e0fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:42:49 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Volume volume-c78e37b2-3ca2-4231-a652-51a909e409b4 (c78e37b2-3ca2-4231-a652-51a909e409b4): created successfully Aug 27 03:42:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46fdbe45-1475-4a1e-b253-e0a15d3e0fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:42:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Flow 'volume_create_manager' (50d41f89-97b2-4134-ba3c-c06967b01771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:42:49 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d37b6f30-5ac7-4e3d-b5fb-8225edafdd1b tempest-VolumesTransfersV355Test-32060908 None] Created volume successfully. Aug 27 03:42:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77ae3ce4-6bdc-4269-80a7-72611d1ab61e tempest-AttachVolumeTestJSON-1763649932 None] Acquiring lock "cinder-d1361249-56b3-4dec-b9f8-792ea5aa7e24-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:42:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77ae3ce4-6bdc-4269-80a7-72611d1ab61e tempest-AttachVolumeTestJSON-1763649932 None] Lock "cinder-d1361249-56b3-4dec-b9f8-792ea5aa7e24-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:42:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77ae3ce4-6bdc-4269-80a7-72611d1ab61e tempest-AttachVolumeTestJSON-1763649932 None] Acquiring lock "cinder-quobyte-d1361249-56b3-4dec-b9f8-792ea5aa7e24" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:42:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77ae3ce4-6bdc-4269-80a7-72611d1ab61e tempest-AttachVolumeTestJSON-1763649932 None] Lock "cinder-quobyte-d1361249-56b3-4dec-b9f8-792ea5aa7e24" acquired by "delete_volume" :: waited 0.028s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:42:49 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[253fe710-acb1-40f4-a8b6-c179063859c8]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:42:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77ae3ce4-6bdc-4269-80a7-72611d1ab61e tempest-AttachVolumeTestJSON-1763649932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d1361249-56b3-4dec-b9f8-792ea5aa7e24 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:49 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d1361249-56b3-4dec-b9f8-792ea5aa7e24 Aug 27 03:42:49 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:49 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77ae3ce4-6bdc-4269-80a7-72611d1ab61e tempest-AttachVolumeTestJSON-1763649932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d1361249-56b3-4dec-b9f8-792ea5aa7e24" returned: 0 in 0.540s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77ae3ce4-6bdc-4269-80a7-72611d1ab61e tempest-AttachVolumeTestJSON-1763649932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d1361249-56b3-4dec-b9f8-792ea5aa7e24 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:50 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d1361249-56b3-4dec-b9f8-792ea5aa7e24 Aug 27 03:42:50 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:50 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77ae3ce4-6bdc-4269-80a7-72611d1ab61e tempest-AttachVolumeTestJSON-1763649932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d1361249-56b3-4dec-b9f8-792ea5aa7e24" returned: 0 in 0.419s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77ae3ce4-6bdc-4269-80a7-72611d1ab61e tempest-AttachVolumeTestJSON-1763649932 None] Lock "cinder-quobyte-d1361249-56b3-4dec-b9f8-792ea5aa7e24" released by "delete_volume" :: held 1.045s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:42:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8b454347-18c0-4778-951f-16876b38b20b tempest-VolumesTransfersV355Test-1471642052 None] Acquiring lock "cinder-c78e37b2-3ca2-4231-a652-51a909e409b4-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:42:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8b454347-18c0-4778-951f-16876b38b20b tempest-VolumesTransfersV355Test-1471642052 None] Lock "cinder-c78e37b2-3ca2-4231-a652-51a909e409b4-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:42:50 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-77ae3ce4-6bdc-4269-80a7-72611d1ab61e tempest-AttachVolumeTestJSON-1763649932 None] Created reservations ['e5ab57fe-982d-4f10-8ce3-80022ca8aed0', 'cfa34ece-e067-42db-9c89-3499349293b0', 'a1325639-e47e-4466-b3b8-1ca3142aa152', 'f4f4bdb5-3c86-476f-ac31-75e508c23113'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:42:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8b454347-18c0-4778-951f-16876b38b20b tempest-VolumesTransfersV355Test-1471642052 None] Acquiring lock "cinder-quobyte-c78e37b2-3ca2-4231-a652-51a909e409b4" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:42:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8b454347-18c0-4778-951f-16876b38b20b tempest-VolumesTransfersV355Test-1471642052 None] Lock "cinder-quobyte-c78e37b2-3ca2-4231-a652-51a909e409b4" acquired by "delete_volume" :: waited 0.026s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:42:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-77ae3ce4-6bdc-4269-80a7-72611d1ab61e tempest-AttachVolumeTestJSON-1763649932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-77ae3ce4-6bdc-4269-80a7-72611d1ab61e tempest-AttachVolumeTestJSON-1763649932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-77ae3ce4-6bdc-4269-80a7-72611d1ab61e tempest-AttachVolumeTestJSON-1763649932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:42:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-77ae3ce4-6bdc-4269-80a7-72611d1ab61e tempest-AttachVolumeTestJSON-1763649932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:42:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-77ae3ce4-6bdc-4269-80a7-72611d1ab61e tempest-AttachVolumeTestJSON-1763649932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77ae3ce4-6bdc-4269-80a7-72611d1ab61e tempest-AttachVolumeTestJSON-1763649932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:50 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac10fe0e-c3d5-4e1a-aded-0f710b669865]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:42:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8b454347-18c0-4778-951f-16876b38b20b tempest-VolumesTransfersV355Test-1471642052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c78e37b2-3ca2-4231-a652-51a909e409b4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:50 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:42:50 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:51 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c78e37b2-3ca2-4231-a652-51a909e409b4 Aug 27 03:42:51 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:51 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77ae3ce4-6bdc-4269-80a7-72611d1ab61e tempest-AttachVolumeTestJSON-1763649932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.426s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:51 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-77ae3ce4-6bdc-4269-80a7-72611d1ab61e tempest-AttachVolumeTestJSON-1763649932 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:42:51 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-77ae3ce4-6bdc-4269-80a7-72611d1ab61e tempest-AttachVolumeTestJSON-1763649932 None] Deleted volume successfully. Aug 27 03:42:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77ae3ce4-6bdc-4269-80a7-72611d1ab61e tempest-AttachVolumeTestJSON-1763649932 None] Lock "cinder-d1361249-56b3-4dec-b9f8-792ea5aa7e24-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:42:51 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8b454347-18c0-4778-951f-16876b38b20b tempest-VolumesTransfersV355Test-1471642052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c78e37b2-3ca2-4231-a652-51a909e409b4" returned: 0 in 0.538s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8b454347-18c0-4778-951f-16876b38b20b tempest-VolumesTransfersV355Test-1471642052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c78e37b2-3ca2-4231-a652-51a909e409b4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:51 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c78e37b2-3ca2-4231-a652-51a909e409b4 Aug 27 03:42:51 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:51 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8b454347-18c0-4778-951f-16876b38b20b tempest-VolumesTransfersV355Test-1471642052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c78e37b2-3ca2-4231-a652-51a909e409b4" returned: 0 in 0.321s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8b454347-18c0-4778-951f-16876b38b20b tempest-VolumesTransfersV355Test-1471642052 None] Lock "cinder-quobyte-c78e37b2-3ca2-4231-a652-51a909e409b4" released by "delete_volume" :: held 0.948s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:42:51 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-8b454347-18c0-4778-951f-16876b38b20b tempest-VolumesTransfersV355Test-1471642052 None] Created reservations ['34a1e0c2-5c65-439b-8a33-99cd063e41a2', 'a2506e55-e7ad-4a24-9dd2-520c1d37c1dd', '871984d6-db14-41c6-9382-288ed2c42200', '393b7b85-da2f-4a87-a1f6-ddb761828c4a'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:42:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-78cd7574-2822-49bf-8bad-8540ebd577f1 tempest-AttachVolumeTestJSON-1763649932 None] Acquiring lock "cinder-2bc948c6-0ef8-4a53-866c-50f13f3eeeb4-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:42:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8b454347-18c0-4778-951f-16876b38b20b tempest-VolumesTransfersV355Test-1471642052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8b454347-18c0-4778-951f-16876b38b20b tempest-VolumesTransfersV355Test-1471642052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8b454347-18c0-4778-951f-16876b38b20b tempest-VolumesTransfersV355Test-1471642052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:42:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8b454347-18c0-4778-951f-16876b38b20b tempest-VolumesTransfersV355Test-1471642052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:42:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8b454347-18c0-4778-951f-16876b38b20b tempest-VolumesTransfersV355Test-1471642052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8b454347-18c0-4778-951f-16876b38b20b tempest-VolumesTransfersV355Test-1471642052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-78cd7574-2822-49bf-8bad-8540ebd577f1 tempest-AttachVolumeTestJSON-1763649932 None] Lock "cinder-2bc948c6-0ef8-4a53-866c-50f13f3eeeb4-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:42:51 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:42:51 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-78cd7574-2822-49bf-8bad-8540ebd577f1 tempest-AttachVolumeTestJSON-1763649932 None] Acquiring lock "cinder-quobyte-2bc948c6-0ef8-4a53-866c-50f13f3eeeb4" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:42:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-78cd7574-2822-49bf-8bad-8540ebd577f1 tempest-AttachVolumeTestJSON-1763649932 None] Lock "cinder-quobyte-2bc948c6-0ef8-4a53-866c-50f13f3eeeb4" acquired by "delete_volume" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:42:51 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff28740-4b64-48c3-9a20-5c73b0d2246d]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:42:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-78cd7574-2822-49bf-8bad-8540ebd577f1 tempest-AttachVolumeTestJSON-1763649932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2bc948c6-0ef8-4a53-866c-50f13f3eeeb4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:52 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2bc948c6-0ef8-4a53-866c-50f13f3eeeb4 Aug 27 03:42:52 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:52 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8b454347-18c0-4778-951f-16876b38b20b tempest-VolumesTransfersV355Test-1471642052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.278s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:52 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-8b454347-18c0-4778-951f-16876b38b20b tempest-VolumesTransfersV355Test-1471642052 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:42:52 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-8b454347-18c0-4778-951f-16876b38b20b tempest-VolumesTransfersV355Test-1471642052 None] Deleted volume successfully. Aug 27 03:42:52 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8b454347-18c0-4778-951f-16876b38b20b tempest-VolumesTransfersV355Test-1471642052 None] Lock "cinder-c78e37b2-3ca2-4231-a652-51a909e409b4-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:42:52 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-78cd7574-2822-49bf-8bad-8540ebd577f1 tempest-AttachVolumeTestJSON-1763649932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2bc948c6-0ef8-4a53-866c-50f13f3eeeb4" returned: 0 in 0.479s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-78cd7574-2822-49bf-8bad-8540ebd577f1 tempest-AttachVolumeTestJSON-1763649932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2bc948c6-0ef8-4a53-866c-50f13f3eeeb4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:52 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2bc948c6-0ef8-4a53-866c-50f13f3eeeb4 Aug 27 03:42:52 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:52 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-78cd7574-2822-49bf-8bad-8540ebd577f1 tempest-AttachVolumeTestJSON-1763649932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2bc948c6-0ef8-4a53-866c-50f13f3eeeb4" returned: 0 in 0.296s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:52 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-78cd7574-2822-49bf-8bad-8540ebd577f1 tempest-AttachVolumeTestJSON-1763649932 None] Lock "cinder-quobyte-2bc948c6-0ef8-4a53-866c-50f13f3eeeb4" released by "delete_volume" :: held 0.821s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:42:52 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-78cd7574-2822-49bf-8bad-8540ebd577f1 tempest-AttachVolumeTestJSON-1763649932 None] Created reservations ['0dfc3128-8638-4da9-9d88-cc825cb20450', 'aaa2e60f-af77-4453-a507-b8418f9d33a4', '4338abac-dfd0-40ec-b094-2d1fb4190568', '09a17c05-17da-451c-825a-9cd2e05bb580'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:42:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-78cd7574-2822-49bf-8bad-8540ebd577f1 tempest-AttachVolumeTestJSON-1763649932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:42:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-78cd7574-2822-49bf-8bad-8540ebd577f1 tempest-AttachVolumeTestJSON-1763649932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:42:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-78cd7574-2822-49bf-8bad-8540ebd577f1 tempest-AttachVolumeTestJSON-1763649932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:42:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-78cd7574-2822-49bf-8bad-8540ebd577f1 tempest-AttachVolumeTestJSON-1763649932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:42:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-78cd7574-2822-49bf-8bad-8540ebd577f1 tempest-AttachVolumeTestJSON-1763649932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:42:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-78cd7574-2822-49bf-8bad-8540ebd577f1 tempest-AttachVolumeTestJSON-1763649932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:42:53 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:42:53 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:42:53 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Aug 27 03:42:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-78cd7574-2822-49bf-8bad-8540ebd577f1 tempest-AttachVolumeTestJSON-1763649932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.673s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:42:53 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-78cd7574-2822-49bf-8bad-8540ebd577f1 tempest-AttachVolumeTestJSON-1763649932 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:42:53 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-78cd7574-2822-49bf-8bad-8540ebd577f1 tempest-AttachVolumeTestJSON-1763649932 None] Deleted volume successfully. Aug 27 03:42:53 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-78cd7574-2822-49bf-8bad-8540ebd577f1 tempest-AttachVolumeTestJSON-1763649932 None] Lock "cinder-2bc948c6-0ef8-4a53-866c-50f13f3eeeb4-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:43:02 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=103,cinder:UPDATE=117,cinder:INSERT=32,cinder:DELETE=8 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:43:03 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=94,cinder:UPDATE=115,cinder:INSERT=34,cinder:DELETE=11 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:43:09 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:43:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Flow 'volume_create_manager' (4fde61b2-7100-48b3-a345-801e01adad3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:43:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3932ab68-171e-42e4-bdca-8046901cc507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3932ab68-171e-42e4-bdca-8046901cc507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2130080372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebcb7843-b8cc-4743-887b-baf7fbbf7bdc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6976ab62a884407aa949e44cff19046e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:43:09Z,use_quota=True,user_id='af39131eff4c469d9dbf8da614747cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07477297-f1b9-4e31-b74b-eecbd8c8f6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07477297-f1b9-4e31-b74b-eecbd8c8f6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d60686d3-e010-4d2f-8c67-6fd4ea233038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d60686d3-e010-4d2f-8c67-6fd4ea233038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebcb7843-b8cc-4743-887b-baf7fbbf7bdc', 'volume_name': 'volume-ebcb7843-b8cc-4743-887b-baf7fbbf7bdc', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76507c77-b6ef-43e9-a125-25ff0fd147f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76507c77-b6ef-43e9-a125-25ff0fd147f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1f52304-a8f6-405d-8d10-8d5462411736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:09 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Volume ebcb7843-b8cc-4743-887b-baf7fbbf7bdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebcb7843-b8cc-4743-887b-baf7fbbf7bdc', 'volume_size': 1} Aug 27 03:43:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:43:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:43:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2130080372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebcb7843-b8cc-4743-887b-baf7fbbf7bdc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6976ab62a884407aa949e44cff19046e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:43:09Z,use_quota=True,user_id='af39131eff4c469d9dbf8da614747cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:43:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Creating volume ebcb7843-b8cc-4743-887b-baf7fbbf7bdc {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:43:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:43:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:43:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:43:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:43:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:43:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:43:09 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:43:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ebcb7843-b8cc-4743-887b-baf7fbbf7bdc 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:09 devstack sudo[100181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ebcb7843-b8cc-4743-887b-baf7fbbf7bdc 1073741824 Aug 27 03:43:09 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:10 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ebcb7843-b8cc-4743-887b-baf7fbbf7bdc 1073741824" returned: 0 in 0.547s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ebcb7843-b8cc-4743-887b-baf7fbbf7bdc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:10 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ebcb7843-b8cc-4743-887b-baf7fbbf7bdc Aug 27 03:43:10 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:10 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ebcb7843-b8cc-4743-887b-baf7fbbf7bdc" returned: 0 in 0.382s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:43:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:43:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1f52304-a8f6-405d-8d10-8d5462411736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebcb7843-b8cc-4743-887b-baf7fbbf7bdc', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61b0368-298b-41f6-8d19-8644fb392cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:10 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Volume volume-ebcb7843-b8cc-4743-887b-baf7fbbf7bdc (ebcb7843-b8cc-4743-887b-baf7fbbf7bdc): created successfully Aug 27 03:43:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61b0368-298b-41f6-8d19-8644fb392cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Flow 'volume_create_manager' (4fde61b2-7100-48b3-a345-801e01adad3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:43:10 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-2a5a31e3-1419-4b00-8190-71a2abf35bf2 tempest-VolumesGetTest-1252533602 None] Created volume successfully. Aug 27 03:43:12 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:43:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Flow 'volume_create_manager' (4b069a13-774d-4669-bf22-6cf426876c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:43:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81887435-38ac-41a4-86ff-50c91983f616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81887435-38ac-41a4-86ff-50c91983f616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:43:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1661463623',display_name='tempest-VolumesGetTest-Volume-502753992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0660e0-ed02-47b7-af18-6b3beb3b81f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6976ab62a884407aa949e44cff19046e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:43:12Z,use_quota=True,user_id='af39131eff4c469d9dbf8da614747cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e29ee1-5804-41b0-8b96-f2b5d573c9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e29ee1-5804-41b0-8b96-f2b5d573c9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (195513ca-534d-4fbc-ab82-ae2488b645a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (195513ca-534d-4fbc-ab82-ae2488b645a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b0660e0-ed02-47b7-af18-6b3beb3b81f8', 'volume_name': 'volume-4b0660e0-ed02-47b7-af18-6b3beb3b81f8', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be02138-9415-417b-bb63-1a573c73115d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be02138-9415-417b-bb63-1a573c73115d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ea894b-62aa-4859-a1d5-f579883feaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:12 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Volume 4b0660e0-ed02-47b7-af18-6b3beb3b81f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b0660e0-ed02-47b7-af18-6b3beb3b81f8', 'volume_size': 1} Aug 27 03:43:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:43:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:43:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:43:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1661463623',display_name='tempest-VolumesGetTest-Volume-502753992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0660e0-ed02-47b7-af18-6b3beb3b81f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6976ab62a884407aa949e44cff19046e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:43:12Z,use_quota=True,user_id='af39131eff4c469d9dbf8da614747cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:43:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Creating volume 4b0660e0-ed02-47b7-af18-6b3beb3b81f8 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:43:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:43:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:43:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:43:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:43:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:43:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:43:12 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:43:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4b0660e0-ed02-47b7-af18-6b3beb3b81f8 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:12 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4b0660e0-ed02-47b7-af18-6b3beb3b81f8 1073741824 Aug 27 03:43:12 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:13 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4b0660e0-ed02-47b7-af18-6b3beb3b81f8 1073741824" returned: 0 in 0.689s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4b0660e0-ed02-47b7-af18-6b3beb3b81f8 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:13 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4b0660e0-ed02-47b7-af18-6b3beb3b81f8 Aug 27 03:43:13 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:13 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4b0660e0-ed02-47b7-af18-6b3beb3b81f8" returned: 0 in 0.311s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:13 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:43:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:43:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ea894b-62aa-4859-a1d5-f579883feaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b0660e0-ed02-47b7-af18-6b3beb3b81f8', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de51e8a-e0c5-4641-9eae-9760d91492cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:13 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Volume volume-4b0660e0-ed02-47b7-af18-6b3beb3b81f8 (4b0660e0-ed02-47b7-af18-6b3beb3b81f8): created successfully Aug 27 03:43:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de51e8a-e0c5-4641-9eae-9760d91492cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Flow 'volume_create_manager' (4b069a13-774d-4669-bf22-6cf426876c62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:43:13 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f06a597b-cf8d-4e92-9202-dc2e697bf51b tempest-VolumesGetTest-1252533602 None] Created volume successfully. Aug 27 03:43:14 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a040d901-b2cd-4eed-8b55-8802d3fe1e6d tempest-VolumesGetTest-1252533602 None] Acquiring lock "cinder-4b0660e0-ed02-47b7-af18-6b3beb3b81f8-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:43:14 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a040d901-b2cd-4eed-8b55-8802d3fe1e6d tempest-VolumesGetTest-1252533602 None] Lock "cinder-4b0660e0-ed02-47b7-af18-6b3beb3b81f8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:43:14 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a040d901-b2cd-4eed-8b55-8802d3fe1e6d tempest-VolumesGetTest-1252533602 None] Acquiring lock "cinder-quobyte-4b0660e0-ed02-47b7-af18-6b3beb3b81f8" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:43:14 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a040d901-b2cd-4eed-8b55-8802d3fe1e6d tempest-VolumesGetTest-1252533602 None] Lock "cinder-quobyte-4b0660e0-ed02-47b7-af18-6b3beb3b81f8" acquired by "delete_volume" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:43:14 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c26a5a-0edb-4e7e-bf03-c8b0ba4d5088]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:43:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a040d901-b2cd-4eed-8b55-8802d3fe1e6d tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4b0660e0-ed02-47b7-af18-6b3beb3b81f8 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:14 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:43:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:43:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:43:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:43:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:43:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:43:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:14 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:43:14 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:14 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4b0660e0-ed02-47b7-af18-6b3beb3b81f8 Aug 27 03:43:14 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:15 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.350s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:43:15 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager._thread_info {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:43:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread count: 28 {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 03:43:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread info: [<_MainThread(MainThread, started 134250325188736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 03:43:15 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a040d901-b2cd-4eed-8b55-8802d3fe1e6d tempest-VolumesGetTest-1252533602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4b0660e0-ed02-47b7-af18-6b3beb3b81f8" returned: 0 in 0.615s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a040d901-b2cd-4eed-8b55-8802d3fe1e6d tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4b0660e0-ed02-47b7-af18-6b3beb3b81f8 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:15 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4b0660e0-ed02-47b7-af18-6b3beb3b81f8 Aug 27 03:43:15 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:15 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a040d901-b2cd-4eed-8b55-8802d3fe1e6d tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4b0660e0-ed02-47b7-af18-6b3beb3b81f8" returned: 0 in 0.318s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:15 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a040d901-b2cd-4eed-8b55-8802d3fe1e6d tempest-VolumesGetTest-1252533602 None] Lock "cinder-quobyte-4b0660e0-ed02-47b7-af18-6b3beb3b81f8" released by "delete_volume" :: held 1.005s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:43:15 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-a040d901-b2cd-4eed-8b55-8802d3fe1e6d tempest-VolumesGetTest-1252533602 None] Created reservations ['a347dbe3-61fa-4bff-8e11-e5e3a8dd2e62', 'a7d0bd4f-8600-4094-8c2e-8c83c53c52eb', 'b88646b3-5d5c-4d58-bb4a-09ce68cb03c0', '3f4fbbff-3d9c-4456-ae96-3d2aad2471c1'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:43:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a040d901-b2cd-4eed-8b55-8802d3fe1e6d tempest-VolumesGetTest-1252533602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:43:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a040d901-b2cd-4eed-8b55-8802d3fe1e6d tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:43:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a040d901-b2cd-4eed-8b55-8802d3fe1e6d tempest-VolumesGetTest-1252533602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:43:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a040d901-b2cd-4eed-8b55-8802d3fe1e6d tempest-VolumesGetTest-1252533602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:43:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a040d901-b2cd-4eed-8b55-8802d3fe1e6d tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:43:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a040d901-b2cd-4eed-8b55-8802d3fe1e6d tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:15 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:43:15 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:16 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a040d901-b2cd-4eed-8b55-8802d3fe1e6d tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.524s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:16 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-a040d901-b2cd-4eed-8b55-8802d3fe1e6d tempest-VolumesGetTest-1252533602 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:43:16 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-a040d901-b2cd-4eed-8b55-8802d3fe1e6d tempest-VolumesGetTest-1252533602 None] Deleted volume successfully. Aug 27 03:43:16 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a040d901-b2cd-4eed-8b55-8802d3fe1e6d tempest-VolumesGetTest-1252533602 None] Lock "cinder-4b0660e0-ed02-47b7-af18-6b3beb3b81f8-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:43:17 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4099b44e-f958-46c0-81e4-4b65cc45eff3 tempest-VolumesGetTest-1252533602 None] Acquiring lock "cinder-ebcb7843-b8cc-4743-887b-baf7fbbf7bdc-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:43:17 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4099b44e-f958-46c0-81e4-4b65cc45eff3 tempest-VolumesGetTest-1252533602 None] Lock "cinder-ebcb7843-b8cc-4743-887b-baf7fbbf7bdc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:43:17 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4099b44e-f958-46c0-81e4-4b65cc45eff3 tempest-VolumesGetTest-1252533602 None] Acquiring lock "cinder-quobyte-ebcb7843-b8cc-4743-887b-baf7fbbf7bdc" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:43:17 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4099b44e-f958-46c0-81e4-4b65cc45eff3 tempest-VolumesGetTest-1252533602 None] Lock "cinder-quobyte-ebcb7843-b8cc-4743-887b-baf7fbbf7bdc" acquired by "delete_volume" :: waited 0.048s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:43:17 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[5814939a-965c-40f5-98c1-0eab261cee72]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:43:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4099b44e-f958-46c0-81e4-4b65cc45eff3 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ebcb7843-b8cc-4743-887b-baf7fbbf7bdc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:17 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ebcb7843-b8cc-4743-887b-baf7fbbf7bdc Aug 27 03:43:17 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:17 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4099b44e-f958-46c0-81e4-4b65cc45eff3 tempest-VolumesGetTest-1252533602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ebcb7843-b8cc-4743-887b-baf7fbbf7bdc" returned: 0 in 0.682s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4099b44e-f958-46c0-81e4-4b65cc45eff3 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ebcb7843-b8cc-4743-887b-baf7fbbf7bdc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:18 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ebcb7843-b8cc-4743-887b-baf7fbbf7bdc Aug 27 03:43:18 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:18 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4099b44e-f958-46c0-81e4-4b65cc45eff3 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ebcb7843-b8cc-4743-887b-baf7fbbf7bdc" returned: 0 in 0.359s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4099b44e-f958-46c0-81e4-4b65cc45eff3 tempest-VolumesGetTest-1252533602 None] Lock "cinder-quobyte-ebcb7843-b8cc-4743-887b-baf7fbbf7bdc" released by "delete_volume" :: held 1.118s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:43:18 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-4099b44e-f958-46c0-81e4-4b65cc45eff3 tempest-VolumesGetTest-1252533602 None] Created reservations ['6efe6472-025f-4595-b2bd-836f02095d28', 'e491d423-336e-4c4a-9dce-43217a9e9637', 'fd0d2392-29c2-4f93-a105-e6eec7099df8', '5a401871-b481-43d8-8496-46764822d159'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:43:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4099b44e-f958-46c0-81e4-4b65cc45eff3 tempest-VolumesGetTest-1252533602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:43:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4099b44e-f958-46c0-81e4-4b65cc45eff3 tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:43:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4099b44e-f958-46c0-81e4-4b65cc45eff3 tempest-VolumesGetTest-1252533602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:43:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4099b44e-f958-46c0-81e4-4b65cc45eff3 tempest-VolumesGetTest-1252533602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:43:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4099b44e-f958-46c0-81e4-4b65cc45eff3 tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:43:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4099b44e-f958-46c0-81e4-4b65cc45eff3 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:18 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:43:18 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:18 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4099b44e-f958-46c0-81e4-4b65cc45eff3 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.385s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:18 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4099b44e-f958-46c0-81e4-4b65cc45eff3 tempest-VolumesGetTest-1252533602 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:43:18 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-4099b44e-f958-46c0-81e4-4b65cc45eff3 tempest-VolumesGetTest-1252533602 None] Deleted volume successfully. Aug 27 03:43:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4099b44e-f958-46c0-81e4-4b65cc45eff3 tempest-VolumesGetTest-1252533602 None] Lock "cinder-ebcb7843-b8cc-4743-887b-baf7fbbf7bdc-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Flow 'volume_create_manager' (ea353769-4e32-466c-8cb9-0a917f662157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4e1946-2c45-4dc0-a2ca-9d37405f66be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4e1946-2c45-4dc0-a2ca-9d37405f66be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-241676260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30612b6f-c78d-4217-a7a3-84d9cb3e6d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38616f385fc04296b23fd6a2b2c48b4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:43:20Z,use_quota=True,user_id='69fb34fd7e7c46d683d0ccb268648d73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16a7795-3f3e-4309-90ce-39f7f4fd19a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16a7795-3f3e-4309-90ce-39f7f4fd19a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc624a6-cee1-43ba-a305-86756680fd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc624a6-cee1-43ba-a305-86756680fd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30612b6f-c78d-4217-a7a3-84d9cb3e6d97', 'volume_name': 'volume-30612b6f-c78d-4217-a7a3-84d9cb3e6d97', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ad418e-b560-4a3e-898e-cf2d578ac5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ad418e-b560-4a3e-898e-cf2d578ac5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15a3d4a8-043f-4525-ac45-ae5d8518c95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:20 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Volume 30612b6f-c78d-4217-a7a3-84d9cb3e6d97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30612b6f-c78d-4217-a7a3-84d9cb3e6d97', 'volume_size': 1} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-241676260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30612b6f-c78d-4217-a7a3-84d9cb3e6d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38616f385fc04296b23fd6a2b2c48b4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:43:20Z,use_quota=True,user_id='69fb34fd7e7c46d683d0ccb268648d73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Creating volume 30612b6f-c78d-4217-a7a3-84d9cb3e6d97 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:43:20 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30612b6f-c78d-4217-a7a3-84d9cb3e6d97 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:43:20 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30612b6f-c78d-4217-a7a3-84d9cb3e6d97 1073741824 Aug 27 03:43:20 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Flow 'volume_create_manager' (c5894711-82e6-494d-9ea6-05a3be9de87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96babc68-5f84-49b7-85e7-7d91d4506f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96babc68-5f84-49b7-85e7-7d91d4506f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1602815520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac58197d-9435-43fd-838b-80d3cb261e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6976ab62a884407aa949e44cff19046e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:43:21Z,use_quota=True,user_id='af39131eff4c469d9dbf8da614747cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97b63122-9c2a-45b6-9822-19ade1df6b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97b63122-9c2a-45b6-9822-19ade1df6b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27464c01-a1d5-4350-ae19-ae6f2996f18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27464c01-a1d5-4350-ae19-ae6f2996f18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac58197d-9435-43fd-838b-80d3cb261e0f', 'volume_name': 'volume-ac58197d-9435-43fd-838b-80d3cb261e0f', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d488a35e-be7b-40ad-9ef8-8edce06fe465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d488a35e-be7b-40ad-9ef8-8edce06fe465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a4c4d1-3d91-41ff-9f29-9e7ea2892ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:21 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Volume ac58197d-9435-43fd-838b-80d3cb261e0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac58197d-9435-43fd-838b-80d3cb261e0f', 'volume_size': 1} Aug 27 03:43:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:43:21 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30612b6f-c78d-4217-a7a3-84d9cb3e6d97 1073741824" returned: 0 in 0.966s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30612b6f-c78d-4217-a7a3-84d9cb3e6d97 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:21 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30612b6f-c78d-4217-a7a3-84d9cb3e6d97 Aug 27 03:43:21 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:22 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30612b6f-c78d-4217-a7a3-84d9cb3e6d97" returned: 0 in 0.585s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:43:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:43:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.466s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:43:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1602815520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac58197d-9435-43fd-838b-80d3cb261e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6976ab62a884407aa949e44cff19046e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:43:21Z,use_quota=True,user_id='af39131eff4c469d9dbf8da614747cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:43:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Creating volume ac58197d-9435-43fd-838b-80d3cb261e0f {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:43:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:43:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:43:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:43:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:43:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:43:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:43:22 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:43:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15a3d4a8-043f-4525-ac45-ae5d8518c95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30612b6f-c78d-4217-a7a3-84d9cb3e6d97', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:22 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f 1073741824 Aug 27 03:43:22 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e114749e-b5c2-4323-afe6-feff5d72bab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:22 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Volume volume-30612b6f-c78d-4217-a7a3-84d9cb3e6d97 (30612b6f-c78d-4217-a7a3-84d9cb3e6d97): created successfully Aug 27 03:43:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e114749e-b5c2-4323-afe6-feff5d72bab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Flow 'volume_create_manager' (ea353769-4e32-466c-8cb9-0a917f662157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:43:22 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-ba4516b6-b218-4363-a81e-5137f7ad9bed tempest-ServerActionsTestOtherA-581085483 None] Created volume successfully. Aug 27 03:43:23 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f 1073741824" returned: 0 in 0.936s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:23 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f Aug 27 03:43:23 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:23 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f" returned: 0 in 0.449s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:23 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:43:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:43:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a4c4d1-3d91-41ff-9f29-9e7ea2892ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac58197d-9435-43fd-838b-80d3cb261e0f', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4166f93-ecb2-4f4c-b0dd-f80b8c52bd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:24 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Volume volume-ac58197d-9435-43fd-838b-80d3cb261e0f (ac58197d-9435-43fd-838b-80d3cb261e0f): created successfully Aug 27 03:43:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4166f93-ecb2-4f4c-b0dd-f80b8c52bd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Flow 'volume_create_manager' (c5894711-82e6-494d-9ea6-05a3be9de87d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:43:24 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f973901a-01b7-469f-8807-7f5c74590c31 tempest-VolumesGetTest-1252533602 None] Created volume successfully. Aug 27 03:43:25 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:43:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Flow 'volume_create_manager' (2893f663-3f0e-4f99-aaf7-635da713f26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:43:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d3d223-e0d0-436a-9ab6-4ceac56dd231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d3d223-e0d0-436a-9ab6-4ceac56dd231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1889761283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5fdbdce-a488-4a7c-a559-bbf37bc14d9e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6976ab62a884407aa949e44cff19046e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ac58197d-9435-43fd-838b-80d3cb261e0f,status='creating',terminated_at=None,updated_at=2026-08-27T01:43:26Z,use_quota=True,user_id='af39131eff4c469d9dbf8da614747cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f6e431-f3eb-41c0-8065-4398025b39c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f6e431-f3eb-41c0-8065-4398025b39c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6deb349a-1fa4-4c07-933b-4ded1afa191a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6deb349a-1fa4-4c07-933b-4ded1afa191a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f5fdbdce-a488-4a7c-a559-bbf37bc14d9e', 'volume_name': 'volume-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e', 'volume_size': 1, 'source_volid': 'ac58197d-9435-43fd-838b-80d3cb261e0f', 'source_volstatus': 'available'}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bce8cb8-85d6-4320-a83f-db864924c541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bce8cb8-85d6-4320-a83f-db864924c541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a28ba04f-68e0-4130-8a4f-f83a6d057c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:26 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Volume f5fdbdce-a488-4a7c-a559-bbf37bc14d9e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e', 'volume_size': 1, 'source_volid': 'ac58197d-9435-43fd-838b-80d3cb261e0f', 'source_volstatus': 'available'} Aug 27 03:43:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:43:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:43:26 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Cloning volume ac58197d-9435-43fd-838b-80d3cb261e0f to volume f5fdbdce-a488-4a7c-a559-bbf37bc14d9e Aug 27 03:43:26 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Creating offline snapshot 7347cf39-8a74-482d-bb2c-8f7b89e92286 of volume ac58197d-9435-43fd-838b-80d3cb261e0f {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:43:26 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[3058e520-fc33-4922-a76e-2d5aaf7f1ce9]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:43:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:26 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f Aug 27 03:43:26 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:26 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f" returned: 0 in 0.557s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.7347cf39-8a74-482d-bb2c-8f7b89e92286 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:26 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.7347cf39-8a74-482d-bb2c-8f7b89e92286 1G Aug 27 03:43:26 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:27 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.7347cf39-8a74-482d-bb2c-8f7b89e92286 1G" returned: 0 in 0.662s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac58197d-9435-43fd-838b-80d3cb261e0f -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.7347cf39-8a74-482d-bb2c-8f7b89e92286 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:27 devstack sudo[100386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac58197d-9435-43fd-838b-80d3cb261e0f -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.7347cf39-8a74-482d-bb2c-8f7b89e92286 Aug 27 03:43:27 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:27 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac58197d-9435-43fd-838b-80d3cb261e0f -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.7347cf39-8a74-482d-bb2c-8f7b89e92286" returned: 0 in 0.401s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:27 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.7347cf39-8a74-482d-bb2c-8f7b89e92286 is being set with open permissions: ugo+rw Aug 27 03:43:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.7347cf39-8a74-482d-bb2c-8f7b89e92286 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:27 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.7347cf39-8a74-482d-bb2c-8f7b89e92286 Aug 27 03:43:27 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:28 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.7347cf39-8a74-482d-bb2c-8f7b89e92286" returned: 0 in 0.512s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:28 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.info Aug 27 03:43:28 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:28 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.info" returned: 0 in 0.369s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:28 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.info is being set with open permissions: ugo+rw Aug 27 03:43:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:28 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.info Aug 27 03:43:28 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:29 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.info" returned: 0 in 0.393s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Acquiring lock "cinder-quobyte-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e" by "_copy_volume_from_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:43:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Lock "cinder-quobyte-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:43:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] snapshot: 7347cf39-8a74-482d-bb2c-8f7b89e92286, volume: f5fdbdce-a488-4a7c-a559-bbf37bc14d9e, {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 27 03:43:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:43:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:43:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:43:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:43:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:43:29 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[766c7d3b-a275-4442-a822-18de538205da]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:43:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.7347cf39-8a74-482d-bb2c-8f7b89e92286 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:29 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.7347cf39-8a74-482d-bb2c-8f7b89e92286 Aug 27 03:43:29 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:30 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.7347cf39-8a74-482d-bb2c-8f7b89e92286" returned: 0 in 0.704s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac58197d-9435-43fd-838b-80d3cb261e0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:43:30 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd1217f-e9f3-48f5-8cf6-5cf47d7c4f50]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:43:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:30 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f Aug 27 03:43:30 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:30 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f" returned: 0 in 0.678s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] will copy from snapshot at /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 27 03:43:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Creating direct copy from snapshot {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 27 03:43:30 devstack cinder-volume[94328]: DEBUG cinder.utils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Path /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e not found in is_blk_device check {{(pid=94328) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 27 03:43:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:30 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e Aug 27 03:43:30 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:37 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e" returned: 0 in 7.107s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:37 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Image conversion details: src /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f, size 1024.00 MB, duration 7.11 sec, destination /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:43:37 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Converted 1024.00 MB image at 144.06 MB/s Aug 27 03:43:37 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e is being set with open permissions: ugo+rw Aug 27 03:43:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:37 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e Aug 27 03:43:37 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:38 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e" returned: 0 in 0.358s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:38 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Lock "cinder-quobyte-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e" released by "_copy_volume_from_snapshot" :: held 9.010s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:43:38 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Acquiring lock "cinder-quobyte-7347cf39-8a74-482d-bb2c-8f7b89e92286" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:43:38 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Lock "cinder-quobyte-7347cf39-8a74-482d-bb2c-8f7b89e92286" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:43:38 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Deleting offline snapshot 7347cf39-8a74-482d-bb2c-8f7b89e92286 of volume ac58197d-9435-43fd-838b-80d3cb261e0f {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:43:38 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] snapshot_file for this snap is: volume-ac58197d-9435-43fd-838b-80d3cb261e0f.7347cf39-8a74-482d-bb2c-8f7b89e92286 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:43:38 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa0467d-9c0f-4db6-80ae-c6781b564cda]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:43:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.7347cf39-8a74-482d-bb2c-8f7b89e92286 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:38 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:UPDATE=31,cinder:SELECT=24,cinder:DELETE=4,cinder:INSERT=8 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:43:38 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.7347cf39-8a74-482d-bb2c-8f7b89e92286 Aug 27 03:43:38 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:38 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.7347cf39-8a74-482d-bb2c-8f7b89e92286" returned: 0 in 0.518s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:38 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac58197d-9435-43fd-838b-80d3cb261e0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:43:38 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f35d4d9-316b-4419-956b-fbf25e32e89f]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:43:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:39 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f Aug 27 03:43:39 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:39 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f" returned: 0 in 0.965s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.7347cf39-8a74-482d-bb2c-8f7b89e92286 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:39 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.7347cf39-8a74-482d-bb2c-8f7b89e92286 Aug 27 03:43:39 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:40 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.7347cf39-8a74-482d-bb2c-8f7b89e92286" returned: 0 in 1.082s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.7347cf39-8a74-482d-bb2c-8f7b89e92286 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:41 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.7347cf39-8a74-482d-bb2c-8f7b89e92286 Aug 27 03:43:41 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:41 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f.7347cf39-8a74-482d-bb2c-8f7b89e92286" returned: 0 in 0.823s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Lock "cinder-quobyte-7347cf39-8a74-482d-bb2c-8f7b89e92286" released by "_delete_snapshot" :: held 3.590s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:43:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.886s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:43:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a28ba04f-68e0-4130-8a4f-f83a6d057c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e', 'volume_size': 1, 'source_volid': 'ac58197d-9435-43fd-838b-80d3cb261e0f', 'source_volstatus': 'available'}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb89e321-d14a-4d9f-a1f0-02c4018f237c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:42 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Volume volume-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e (f5fdbdce-a488-4a7c-a559-bbf37bc14d9e): created successfully Aug 27 03:43:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb89e321-d14a-4d9f-a1f0-02c4018f237c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Flow 'volume_create_manager' (2893f663-3f0e-4f99-aaf7-635da713f26b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:43:42 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-1d635fa0-c747-443a-864d-f63eeb23d781 tempest-VolumesGetTest-1252533602 None] Created volume successfully. Aug 27 03:43:43 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:43:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Flow 'volume_create_manager' (0dba41e5-dc0d-4160-8f57-870d8928bad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:43:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc54a480-963b-43e7-86a8-c5f08eefd8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc54a480-963b-43e7-86a8-c5f08eefd8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:43:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-308167923',display_name='tempest-VolumesGetTest-Volume-494991176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69917bd-4eed-41ee-9757-de956754036d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6976ab62a884407aa949e44cff19046e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:43:43Z,use_quota=True,user_id='af39131eff4c469d9dbf8da614747cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c8b4a0-0b11-46e8-8fcb-e2774b1927e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c8b4a0-0b11-46e8-8fcb-e2774b1927e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba77f5f5-8569-487c-a00c-2b90fa11a22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba77f5f5-8569-487c-a00c-2b90fa11a22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b69917bd-4eed-41ee-9757-de956754036d', 'volume_name': 'volume-b69917bd-4eed-41ee-9757-de956754036d', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c19d8d-75d4-4ff5-a4f4-5142f51d29c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c19d8d-75d4-4ff5-a4f4-5142f51d29c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df8ec43-b853-46e0-8976-aa4db2ba27fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:43 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Volume b69917bd-4eed-41ee-9757-de956754036d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b69917bd-4eed-41ee-9757-de956754036d', 'volume_size': 1} Aug 27 03:43:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:43:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:43:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:43:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-308167923',display_name='tempest-VolumesGetTest-Volume-494991176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69917bd-4eed-41ee-9757-de956754036d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6976ab62a884407aa949e44cff19046e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:43:43Z,use_quota=True,user_id='af39131eff4c469d9dbf8da614747cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:43:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Creating volume b69917bd-4eed-41ee-9757-de956754036d {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:43:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:43:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:43:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:43:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:43:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:43:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:43:43 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:43:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b69917bd-4eed-41ee-9757-de956754036d 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:43 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b69917bd-4eed-41ee-9757-de956754036d 1073741824 Aug 27 03:43:43 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:44 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b69917bd-4eed-41ee-9757-de956754036d 1073741824" returned: 0 in 0.805s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b69917bd-4eed-41ee-9757-de956754036d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:44 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b69917bd-4eed-41ee-9757-de956754036d Aug 27 03:43:44 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:44 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b69917bd-4eed-41ee-9757-de956754036d" returned: 0 in 0.271s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:43:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:43:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df8ec43-b853-46e0-8976-aa4db2ba27fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b69917bd-4eed-41ee-9757-de956754036d', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb4cf30f-47e7-41e8-9c2c-8b48f2dfbaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:44 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Volume volume-b69917bd-4eed-41ee-9757-de956754036d (b69917bd-4eed-41ee-9757-de956754036d): created successfully Aug 27 03:43:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb4cf30f-47e7-41e8-9c2c-8b48f2dfbaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Flow 'volume_create_manager' (0dba41e5-dc0d-4160-8f57-870d8928bad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:43:44 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-520869d4-a2e2-4e76-b7e2-a633e53e9c40 tempest-VolumesGetTest-1252533602 None] Created volume successfully. Aug 27 03:43:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2a5e382a-0549-4329-b714-a69453717009 tempest-VolumesGetTest-1252533602 None] Acquiring lock "cinder-b69917bd-4eed-41ee-9757-de956754036d-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:43:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2a5e382a-0549-4329-b714-a69453717009 tempest-VolumesGetTest-1252533602 None] Lock "cinder-b69917bd-4eed-41ee-9757-de956754036d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:43:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2a5e382a-0549-4329-b714-a69453717009 tempest-VolumesGetTest-1252533602 None] Acquiring lock "cinder-quobyte-b69917bd-4eed-41ee-9757-de956754036d" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2a5e382a-0549-4329-b714-a69453717009 tempest-VolumesGetTest-1252533602 None] Lock "cinder-quobyte-b69917bd-4eed-41ee-9757-de956754036d" acquired by "delete_volume" :: waited 0.070s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[6368f7db-df14-4a4c-a334-871cbf3c614e]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2a5e382a-0549-4329-b714-a69453717009 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b69917bd-4eed-41ee-9757-de956754036d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:46 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b69917bd-4eed-41ee-9757-de956754036d Aug 27 03:43:46 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Flow 'volume_create_manager' (cf273641-7a80-4c85-9b82-08068ca0e773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aad1387-236b-4ee8-aa40-f933fe6a2107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aad1387-236b-4ee8-aa40-f933fe6a2107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-304821933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb506456-d08d-4f4d-81ff-bd95378c590c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830f816f5a9f4250a4938930ae3ccfc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:43:46Z,use_quota=True,user_id='85661c06426a4b62bbba4cb6a376dee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164a309c-3452-4308-9105-d2b12ed88c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164a309c-3452-4308-9105-d2b12ed88c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd2910f-ac61-48f9-9f06-e79434c31893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd2910f-ac61-48f9-9f06-e79434c31893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb506456-d08d-4f4d-81ff-bd95378c590c', 'volume_name': 'volume-eb506456-d08d-4f4d-81ff-bd95378c590c', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7bfdec-8e23-403c-b05a-8278a28f5b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7bfdec-8e23-403c-b05a-8278a28f5b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09a7204-9ff7-42e9-89db-cef23a0212f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:46 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Volume eb506456-d08d-4f4d-81ff-bd95378c590c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb506456-d08d-4f4d-81ff-bd95378c590c', 'volume_size': 1} Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-304821933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb506456-d08d-4f4d-81ff-bd95378c590c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830f816f5a9f4250a4938930ae3ccfc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:43:46Z,use_quota=True,user_id='85661c06426a4b62bbba4cb6a376dee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Creating volume eb506456-d08d-4f4d-81ff-bd95378c590c {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:43:46 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:43:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eb506456-d08d-4f4d-81ff-bd95378c590c 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:46 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eb506456-d08d-4f4d-81ff-bd95378c590c 1073741824 Aug 27 03:43:46 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:47 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2a5e382a-0549-4329-b714-a69453717009 tempest-VolumesGetTest-1252533602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b69917bd-4eed-41ee-9757-de956754036d" returned: 0 in 0.988s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2a5e382a-0549-4329-b714-a69453717009 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b69917bd-4eed-41ee-9757-de956754036d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:47 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b69917bd-4eed-41ee-9757-de956754036d Aug 27 03:43:47 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:47 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2a5e382a-0549-4329-b714-a69453717009 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b69917bd-4eed-41ee-9757-de956754036d" returned: 0 in 0.354s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:47 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2a5e382a-0549-4329-b714-a69453717009 tempest-VolumesGetTest-1252533602 None] Lock "cinder-quobyte-b69917bd-4eed-41ee-9757-de956754036d" released by "delete_volume" :: held 1.442s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:43:47 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eb506456-d08d-4f4d-81ff-bd95378c590c 1073741824" returned: 0 in 0.914s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:47 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-2a5e382a-0549-4329-b714-a69453717009 tempest-VolumesGetTest-1252533602 None] Created reservations ['a564146b-cf6a-4d54-a2d6-96358809d1d8', 'e0358546-03de-4e0b-bd71-473a1d67be42', '446a0086-3a99-4571-bd4c-532136ef684f', '28b36d4a-42e8-460b-8195-498ae268a756'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:43:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eb506456-d08d-4f4d-81ff-bd95378c590c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:47 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eb506456-d08d-4f4d-81ff-bd95378c590c Aug 27 03:43:47 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2a5e382a-0549-4329-b714-a69453717009 tempest-VolumesGetTest-1252533602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:43:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2a5e382a-0549-4329-b714-a69453717009 tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:43:47 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2a5e382a-0549-4329-b714-a69453717009 tempest-VolumesGetTest-1252533602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:43:47 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2a5e382a-0549-4329-b714-a69453717009 tempest-VolumesGetTest-1252533602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:43:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2a5e382a-0549-4329-b714-a69453717009 tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:43:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2a5e382a-0549-4329-b714-a69453717009 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:47 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:43:47 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:48 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eb506456-d08d-4f4d-81ff-bd95378c590c" returned: 0 in 0.593s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:43:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:43:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09a7204-9ff7-42e9-89db-cef23a0212f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb506456-d08d-4f4d-81ff-bd95378c590c', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:48 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78567b5b-2fb8-456d-8dd0-dde6e80d4fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2a5e382a-0549-4329-b714-a69453717009 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.584s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:48 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-2a5e382a-0549-4329-b714-a69453717009 tempest-VolumesGetTest-1252533602 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:43:48 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Volume volume-eb506456-d08d-4f4d-81ff-bd95378c590c (eb506456-d08d-4f4d-81ff-bd95378c590c): created successfully Aug 27 03:43:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78567b5b-2fb8-456d-8dd0-dde6e80d4fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Flow 'volume_create_manager' (cf273641-7a80-4c85-9b82-08068ca0e773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:43:48 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-2a5e382a-0549-4329-b714-a69453717009 tempest-VolumesGetTest-1252533602 None] Deleted volume successfully. Aug 27 03:43:48 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-25e98104-2309-44a1-9193-0a44900dd2c1 tempest-AttachVolumeShelveTestJSON-701099279 None] Created volume successfully. Aug 27 03:43:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2a5e382a-0549-4329-b714-a69453717009 tempest-VolumesGetTest-1252533602 None] Lock "cinder-b69917bd-4eed-41ee-9757-de956754036d-delete_volume" released by "delete_volume" :: held 2.580s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:43:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8feeb6e9-cc06-4d83-adc9-15f0433c2a4f tempest-VolumesGetTest-1252533602 None] Acquiring lock "cinder-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:43:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8feeb6e9-cc06-4d83-adc9-15f0433c2a4f tempest-VolumesGetTest-1252533602 None] Lock "cinder-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:43:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8feeb6e9-cc06-4d83-adc9-15f0433c2a4f tempest-VolumesGetTest-1252533602 None] Acquiring lock "cinder-quobyte-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:43:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8feeb6e9-cc06-4d83-adc9-15f0433c2a4f tempest-VolumesGetTest-1252533602 None] Lock "cinder-quobyte-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e" acquired by "delete_volume" :: waited 0.023s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:43:48 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9668b43-a3fc-4ffd-80c2-eef39a611e97]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:43:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8feeb6e9-cc06-4d83-adc9-15f0433c2a4f tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:48 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e Aug 27 03:43:48 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:49 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8feeb6e9-cc06-4d83-adc9-15f0433c2a4f tempest-VolumesGetTest-1252533602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e" returned: 0 in 0.739s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8feeb6e9-cc06-4d83-adc9-15f0433c2a4f tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:49 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e Aug 27 03:43:49 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:49 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8feeb6e9-cc06-4d83-adc9-15f0433c2a4f tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e" returned: 0 in 0.398s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8feeb6e9-cc06-4d83-adc9-15f0433c2a4f tempest-VolumesGetTest-1252533602 None] Lock "cinder-quobyte-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e" released by "delete_volume" :: held 1.257s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:43:50 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-8feeb6e9-cc06-4d83-adc9-15f0433c2a4f tempest-VolumesGetTest-1252533602 None] Created reservations ['5476195e-3e20-4e76-8500-83dac1e58af1', 'e0d2acc0-64ef-425e-87a0-58fa2bfbd664', 'f95093df-2b2d-4043-a85f-d6cf62a21f4b', 'abcea4e9-252c-408e-ab58-67fe23d4e302'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:43:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8feeb6e9-cc06-4d83-adc9-15f0433c2a4f tempest-VolumesGetTest-1252533602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:43:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8feeb6e9-cc06-4d83-adc9-15f0433c2a4f tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:43:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8feeb6e9-cc06-4d83-adc9-15f0433c2a4f tempest-VolumesGetTest-1252533602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:43:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8feeb6e9-cc06-4d83-adc9-15f0433c2a4f tempest-VolumesGetTest-1252533602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:43:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8feeb6e9-cc06-4d83-adc9-15f0433c2a4f tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:43:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8feeb6e9-cc06-4d83-adc9-15f0433c2a4f tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:50 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:43:50 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:50 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8feeb6e9-cc06-4d83-adc9-15f0433c2a4f tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.403s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:50 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-8feeb6e9-cc06-4d83-adc9-15f0433c2a4f tempest-VolumesGetTest-1252533602 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:43:50 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-8feeb6e9-cc06-4d83-adc9-15f0433c2a4f tempest-VolumesGetTest-1252533602 None] Deleted volume successfully. Aug 27 03:43:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8feeb6e9-cc06-4d83-adc9-15f0433c2a4f tempest-VolumesGetTest-1252533602 None] Lock "cinder-f5fdbdce-a488-4a7c-a559-bbf37bc14d9e-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:43:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f9275e19-007d-437c-bcb8-72e53182da25 tempest-VolumesGetTest-1252533602 None] Acquiring lock "cinder-ac58197d-9435-43fd-838b-80d3cb261e0f-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:43:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f9275e19-007d-437c-bcb8-72e53182da25 tempest-VolumesGetTest-1252533602 None] Lock "cinder-ac58197d-9435-43fd-838b-80d3cb261e0f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:43:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f9275e19-007d-437c-bcb8-72e53182da25 tempest-VolumesGetTest-1252533602 None] Acquiring lock "cinder-quobyte-ac58197d-9435-43fd-838b-80d3cb261e0f" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:43:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f9275e19-007d-437c-bcb8-72e53182da25 tempest-VolumesGetTest-1252533602 None] Lock "cinder-quobyte-ac58197d-9435-43fd-838b-80d3cb261e0f" acquired by "delete_volume" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:43:51 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb345f9-a411-415e-9490-bd98cee44ef5]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:43:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f9275e19-007d-437c-bcb8-72e53182da25 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:51 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f Aug 27 03:43:51 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:51 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f9275e19-007d-437c-bcb8-72e53182da25 tempest-VolumesGetTest-1252533602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f" returned: 0 in 0.469s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f9275e19-007d-437c-bcb8-72e53182da25 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:51 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f Aug 27 03:43:51 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:52 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f9275e19-007d-437c-bcb8-72e53182da25 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac58197d-9435-43fd-838b-80d3cb261e0f" returned: 0 in 0.355s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:52 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f9275e19-007d-437c-bcb8-72e53182da25 tempest-VolumesGetTest-1252533602 None] Lock "cinder-quobyte-ac58197d-9435-43fd-838b-80d3cb261e0f" released by "delete_volume" :: held 0.912s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:43:52 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-f9275e19-007d-437c-bcb8-72e53182da25 tempest-VolumesGetTest-1252533602 None] Created reservations ['94dc02b6-64b9-4dd9-91a8-8602f3a93b75', '8e2beabe-1a39-410c-964c-fa7970b3363d', 'f986ba8a-afa1-4fc5-91b0-19c9bc63c23c', 'f2b95365-6940-4eea-9925-4697254ece8e'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:43:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f9275e19-007d-437c-bcb8-72e53182da25 tempest-VolumesGetTest-1252533602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:43:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f9275e19-007d-437c-bcb8-72e53182da25 tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:43:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f9275e19-007d-437c-bcb8-72e53182da25 tempest-VolumesGetTest-1252533602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:43:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f9275e19-007d-437c-bcb8-72e53182da25 tempest-VolumesGetTest-1252533602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:43:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f9275e19-007d-437c-bcb8-72e53182da25 tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:43:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f9275e19-007d-437c-bcb8-72e53182da25 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:52 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:43:52 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:52 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f9275e19-007d-437c-bcb8-72e53182da25 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.426s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:52 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-f9275e19-007d-437c-bcb8-72e53182da25 tempest-VolumesGetTest-1252533602 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:43:52 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f9275e19-007d-437c-bcb8-72e53182da25 tempest-VolumesGetTest-1252533602 None] Deleted volume successfully. Aug 27 03:43:53 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f9275e19-007d-437c-bcb8-72e53182da25 tempest-VolumesGetTest-1252533602 None] Lock "cinder-ac58197d-9435-43fd-838b-80d3cb261e0f-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:43:54 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:43:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Flow 'volume_create_manager' (309296c0-7786-4ac7-9ddd-18d32ea4c342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:43:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62510744-fa71-427f-abfd-30db001077f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62510744-fa71-427f-abfd-30db001077f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-963354969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6593b8da-4166-4a51-94ea-87950d08846b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6976ab62a884407aa949e44cff19046e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:43:54Z,use_quota=True,user_id='af39131eff4c469d9dbf8da614747cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4168b740-bd2c-4565-aecf-90a1ee87f361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4168b740-bd2c-4565-aecf-90a1ee87f361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b7f1c0-1754-433a-b971-6f4e751fb8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:54 devstack cinder-volume[94328]: DEBUG cinder.image.glance [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Creating Keystone auth plugin from conf {{(pid=94328) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 27 03:43:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b7f1c0-1754-433a-b971-6f4e751fb8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6593b8da-4166-4a51-94ea-87950d08846b', 'volume_name': 'volume-6593b8da-4166-4a51-94ea-87950d08846b', 'volume_size': 1, 'image_id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9b1f4295d504303ad90dfddaa1fb97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'created_at': datetime.datetime(2026, 8, 27, 1, 33, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 33, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f226020c-e698-42bf-8a64-41bbbde77748/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e05a93f-537f-4845-9f2f-3e83a757f0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e05a93f-537f-4845-9f2f-3e83a757f0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:43:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48956de6-dfb4-4b23-b281-45c1c035a453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:43:54 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Volume 6593b8da-4166-4a51-94ea-87950d08846b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6593b8da-4166-4a51-94ea-87950d08846b', 'volume_size': 1, 'image_id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9b1f4295d504303ad90dfddaa1fb97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'created_at': datetime.datetime(2026, 8, 27, 1, 33, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 33, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f226020c-e698-42bf-8a64-41bbbde77748/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 27 03:43:54 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Trying to clone 6593b8da-4166-4a51-94ea-87950d08846b from image f226020c-e698-42bf-8a64-41bbbde77748 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}]). {{(pid=94328) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 27 03:43:55 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_kjd4s9gldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 27 03:43:55 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Image download 20.69 MB at 20.69 MB/s Aug 27 03:43:55 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[0644cd89-39b9-4114-901a-1cd08b719be8]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:43:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_kjd4s9gldevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:55 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_kjd4s9gldevstack@QuobyteHD Aug 27 03:43:55 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:55 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_kjd4s9gldevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:55 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Temporary image f226020c-e698-42bf-8a64-41bbbde77748 is fetched for user af39131eff4c469d9dbf8da614747cdb. {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 27 03:43:55 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[9294af3f-343a-4517-aea8-a1fa915b9031]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:43:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_kjd4s9gldevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:55 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_kjd4s9gldevstack@QuobyteHD Aug 27 03:43:55 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:56 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_kjd4s9gldevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:43:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:43:56 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-963354969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6593b8da-4166-4a51-94ea-87950d08846b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6976ab62a884407aa949e44cff19046e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:43:54Z,use_quota=True,user_id='af39131eff4c469d9dbf8da614747cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:43:56 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Creating volume 6593b8da-4166-4a51-94ea-87950d08846b {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:43:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:43:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:43:56 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:43:56 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:43:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:43:56 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:43:56 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:43:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6593b8da-4166-4a51-94ea-87950d08846b 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:56 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6593b8da-4166-4a51-94ea-87950d08846b 1073741824 Aug 27 03:43:56 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:56 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6593b8da-4166-4a51-94ea-87950d08846b 1073741824" returned: 0 in 0.629s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6593b8da-4166-4a51-94ea-87950d08846b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:56 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6593b8da-4166-4a51-94ea-87950d08846b Aug 27 03:43:56 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:57 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6593b8da-4166-4a51-94ea-87950d08846b" returned: 0 in 0.303s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:43:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:43:57 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Attempting download of f226020c-e698-42bf-8a64-41bbbde77748 ((None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}])) to volume 6593b8da-4166-4a51-94ea-87950d08846b. {{(pid=94328) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 27 03:43:57 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[05703521-17b6-4f9b-979d-38b8f487bd57]: (4, 'raw') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:43:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_wovojn_0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:57 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_wovojn_0 Aug 27 03:43:57 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:57 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_wovojn_0" returned: 0 in 0.340s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_wovojn_0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:57 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_wovojn_0 Aug 27 03:43:57 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:57 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_wovojn_0" returned: 1 in 0.441s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_wovojn_0' failed. Not Retrying. {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 27 03:43:57 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1e4fe7-e8e2-4a38-a5dd-605cbca886d6]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:43:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_kjd4s9gldevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:58 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_kjd4s9gldevstack@QuobyteHD Aug 27 03:43:58 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:43:58 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Aug 27 03:43:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_kjd4s9gldevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:43:58 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] f226020c-e698-42bf-8a64-41bbbde77748 was qcow2, converting to qcow2 {{(pid=94328) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 27 03:43:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_kjd4s9gldevstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6593b8da-4166-4a51-94ea-87950d08846b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:43:58 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_kjd4s9gldevstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6593b8da-4166-4a51-94ea-87950d08846b Aug 27 03:43:58 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-58771b85-b93c-42d4-b923-6dce2afbb20d req-0f53b2c3-d331-4172-97d0-7cef6cc5f979 tempest-AttachVolumeShelveTestJSON-701099279 None] No connector for attachment 3348d9a7-c91d-4fa4-96c6-f6f0eca0b06f; skipping storage backend terminate_connection call. {{(pid=94328) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 27 03:44:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-58771b85-b93c-42d4-b923-6dce2afbb20d req-0f53b2c3-d331-4172-97d0-7cef6cc5f979 tempest-AttachVolumeShelveTestJSON-701099279 None] Deleting attachment 3348d9a7-c91d-4fa4-96c6-f6f0eca0b06f. {{(pid=94328) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 27 03:44:00 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_kjd4s9gldevstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6593b8da-4166-4a51-94ea-87950d08846b" returned: 0 in 1.881s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:00 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_kjd4s9gldevstack@QuobyteHD, size 112.00 MB, duration 1.88 sec, destination /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6593b8da-4166-4a51-94ea-87950d08846b {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:44:00 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Converted 112.00 MB image at 59.51 MB/s Aug 27 03:44:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6593b8da-4166-4a51-94ea-87950d08846b 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:00 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6593b8da-4166-4a51-94ea-87950d08846b 1G Aug 27 03:44:00 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:00 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6593b8da-4166-4a51-94ea-87950d08846b 1G" returned: 0 in 0.335s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:00 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Downloaded image f226020c-e698-42bf-8a64-41bbbde77748 ((None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}])) to volume 6593b8da-4166-4a51-94ea-87950d08846b successfully. {{(pid=94328) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 27 03:44:00 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Temporary image f226020c-e698-42bf-8a64-41bbbde77748 for user af39131eff4c469d9dbf8da614747cdb is deleted. {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 27 03:44:00 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Marking volume 6593b8da-4166-4a51-94ea-87950d08846b as bootable. {{(pid=94328) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 27 03:44:00 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Copying metadata from image f226020c-e698-42bf-8a64-41bbbde77748 to 6593b8da-4166-4a51-94ea-87950d08846b. {{(pid=94328) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 27 03:44:00 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Creating volume glance metadata for volume 6593b8da-4166-4a51-94ea-87950d08846b backed by image f226020c-e698-42bf-8a64-41bbbde77748 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94328) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 27 03:44:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48956de6-dfb4-4b23-b281-45c1c035a453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6593b8da-4166-4a51-94ea-87950d08846b', 'volume_size': 1, 'image_id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9b1f4295d504303ad90dfddaa1fb97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'created_at': datetime.datetime(2026, 8, 27, 1, 33, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 33, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f226020c-e698-42bf-8a64-41bbbde77748/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f5f320-9870-4782-9544-242e205659fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:00 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Volume volume-6593b8da-4166-4a51-94ea-87950d08846b (6593b8da-4166-4a51-94ea-87950d08846b): created successfully Aug 27 03:44:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f5f320-9870-4782-9544-242e205659fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Flow 'volume_create_manager' (309296c0-7786-4ac7-9ddd-18d32ea4c342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:44:00 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-73f0de58-0690-41b1-b83f-d154282c322b tempest-VolumesGetTest-1252533602 None] Created volume successfully. Aug 27 03:44:01 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:44:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Flow 'volume_create_manager' (ab487aaf-dee2-46c5-a1ea-d823affd3d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:44:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42a6790-f540-4459-97ed-d8aa5c80652d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42a6790-f540-4459-97ed-d8aa5c80652d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:44:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1853201928',display_name='tempest-VolumesGetTest-Volume-631743309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c54c3a0-e0db-4777-b19c-6a7ef4786aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6976ab62a884407aa949e44cff19046e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:44:02Z,use_quota=True,user_id='af39131eff4c469d9dbf8da614747cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21bee156-f187-4d94-8d0e-de61337d7602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21bee156-f187-4d94-8d0e-de61337d7602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95b8c58d-3197-4b53-8d7b-7da656a3be02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95b8c58d-3197-4b53-8d7b-7da656a3be02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c54c3a0-e0db-4777-b19c-6a7ef4786aa8', 'volume_name': 'volume-0c54c3a0-e0db-4777-b19c-6a7ef4786aa8', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe51306-805b-49c7-b8e3-ba64b51a28e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe51306-805b-49c7-b8e3-ba64b51a28e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d48482-98ed-4da8-9168-a454fa608f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:01 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Volume 0c54c3a0-e0db-4777-b19c-6a7ef4786aa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c54c3a0-e0db-4777-b19c-6a7ef4786aa8', 'volume_size': 1} Aug 27 03:44:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:44:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:44:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:44:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1853201928',display_name='tempest-VolumesGetTest-Volume-631743309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c54c3a0-e0db-4777-b19c-6a7ef4786aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6976ab62a884407aa949e44cff19046e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:44:02Z,use_quota=True,user_id='af39131eff4c469d9dbf8da614747cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:44:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Creating volume 0c54c3a0-e0db-4777-b19c-6a7ef4786aa8 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:44:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:44:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:44:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:44:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:44:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:44:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:44:01 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:44:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0c54c3a0-e0db-4777-b19c-6a7ef4786aa8 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:01 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0c54c3a0-e0db-4777-b19c-6a7ef4786aa8 1073741824 Aug 27 03:44:01 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:02 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0c54c3a0-e0db-4777-b19c-6a7ef4786aa8 1073741824" returned: 0 in 0.563s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0c54c3a0-e0db-4777-b19c-6a7ef4786aa8 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:02 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0c54c3a0-e0db-4777-b19c-6a7ef4786aa8 Aug 27 03:44:02 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:02 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0c54c3a0-e0db-4777-b19c-6a7ef4786aa8" returned: 0 in 0.273s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:02 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:44:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:44:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d48482-98ed-4da8-9168-a454fa608f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c54c3a0-e0db-4777-b19c-6a7ef4786aa8', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3d9c32-8300-4545-bd51-6ae84e08f45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:02 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Volume volume-0c54c3a0-e0db-4777-b19c-6a7ef4786aa8 (0c54c3a0-e0db-4777-b19c-6a7ef4786aa8): created successfully Aug 27 03:44:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3d9c32-8300-4545-bd51-6ae84e08f45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Flow 'volume_create_manager' (ab487aaf-dee2-46c5-a1ea-d823affd3d26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:44:02 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-8c2f0d47-7cb7-4e44-953a-2e5bf4514a75 tempest-VolumesGetTest-1252533602 None] Created volume successfully. Aug 27 03:44:04 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8a8afc6f-6871-45ac-9b8d-8c2d2b8f2c0a tempest-VolumesGetTest-1252533602 None] Acquiring lock "cinder-0c54c3a0-e0db-4777-b19c-6a7ef4786aa8-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:44:04 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8a8afc6f-6871-45ac-9b8d-8c2d2b8f2c0a tempest-VolumesGetTest-1252533602 None] Lock "cinder-0c54c3a0-e0db-4777-b19c-6a7ef4786aa8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:44:04 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=56,cinder:UPDATE=61,cinder:INSERT=22,cinder:DELETE=5 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:44:04 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8a8afc6f-6871-45ac-9b8d-8c2d2b8f2c0a tempest-VolumesGetTest-1252533602 None] Acquiring lock "cinder-quobyte-0c54c3a0-e0db-4777-b19c-6a7ef4786aa8" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:44:04 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8a8afc6f-6871-45ac-9b8d-8c2d2b8f2c0a tempest-VolumesGetTest-1252533602 None] Lock "cinder-quobyte-0c54c3a0-e0db-4777-b19c-6a7ef4786aa8" acquired by "delete_volume" :: waited 0.025s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:44:04 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6062ed4-a44d-4481-979a-ff9eb29372db]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:44:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8a8afc6f-6871-45ac-9b8d-8c2d2b8f2c0a tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0c54c3a0-e0db-4777-b19c-6a7ef4786aa8 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:04 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0c54c3a0-e0db-4777-b19c-6a7ef4786aa8 Aug 27 03:44:04 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:04 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8a8afc6f-6871-45ac-9b8d-8c2d2b8f2c0a tempest-VolumesGetTest-1252533602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0c54c3a0-e0db-4777-b19c-6a7ef4786aa8" returned: 0 in 0.524s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8a8afc6f-6871-45ac-9b8d-8c2d2b8f2c0a tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0c54c3a0-e0db-4777-b19c-6a7ef4786aa8 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:04 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0c54c3a0-e0db-4777-b19c-6a7ef4786aa8 Aug 27 03:44:04 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:05 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8a8afc6f-6871-45ac-9b8d-8c2d2b8f2c0a tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0c54c3a0-e0db-4777-b19c-6a7ef4786aa8" returned: 0 in 0.377s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8a8afc6f-6871-45ac-9b8d-8c2d2b8f2c0a tempest-VolumesGetTest-1252533602 None] Lock "cinder-quobyte-0c54c3a0-e0db-4777-b19c-6a7ef4786aa8" released by "delete_volume" :: held 0.986s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:44:05 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-8a8afc6f-6871-45ac-9b8d-8c2d2b8f2c0a tempest-VolumesGetTest-1252533602 None] Created reservations ['e419f708-2952-444f-9027-10ed02268354', '40ddeb24-84b8-48a6-b382-4f62b70a5e85', 'c1a7fe6f-d34f-4348-bd9a-3ebf87837aee', 'c56d4723-c8f9-42b8-9337-2b75b0472454'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:44:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8a8afc6f-6871-45ac-9b8d-8c2d2b8f2c0a tempest-VolumesGetTest-1252533602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:44:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8a8afc6f-6871-45ac-9b8d-8c2d2b8f2c0a tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:44:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8a8afc6f-6871-45ac-9b8d-8c2d2b8f2c0a tempest-VolumesGetTest-1252533602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:44:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8a8afc6f-6871-45ac-9b8d-8c2d2b8f2c0a tempest-VolumesGetTest-1252533602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:44:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8a8afc6f-6871-45ac-9b8d-8c2d2b8f2c0a tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:44:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8a8afc6f-6871-45ac-9b8d-8c2d2b8f2c0a tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:05 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:44:05 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-20247a75-e6bb-4945-af4f-cd93a828e255 req-c24927a9-bbf1-4ccd-b968-212070521030 tempest-ServerActionsTestOtherA-581085483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:44:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-20247a75-e6bb-4945-af4f-cd93a828e255 req-c24927a9-bbf1-4ccd-b968-212070521030 tempest-ServerActionsTestOtherA-581085483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:44:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-20247a75-e6bb-4945-af4f-cd93a828e255 req-c24927a9-bbf1-4ccd-b968-212070521030 tempest-ServerActionsTestOtherA-581085483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:44:05 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8a8afc6f-6871-45ac-9b8d-8c2d2b8f2c0a tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.334s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:05 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-8a8afc6f-6871-45ac-9b8d-8c2d2b8f2c0a tempest-VolumesGetTest-1252533602 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:44:05 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-8a8afc6f-6871-45ac-9b8d-8c2d2b8f2c0a tempest-VolumesGetTest-1252533602 None] Deleted volume successfully. Aug 27 03:44:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-20247a75-e6bb-4945-af4f-cd93a828e255 req-c24927a9-bbf1-4ccd-b968-212070521030 tempest-ServerActionsTestOtherA-581085483 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac', 'name': 'volume-30612b6f-c78d-4217-a7a3-84d9cb3e6d97', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '102d406f-d61a-48bd-bba1-4abc7a3fca08', 'enforce_multipath': True} {{(pid=94328) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 27 03:44:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8a8afc6f-6871-45ac-9b8d-8c2d2b8f2c0a tempest-VolumesGetTest-1252533602 None] Lock "cinder-0c54c3a0-e0db-4777-b19c-6a7ef4786aa8-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:44:05 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-20247a75-e6bb-4945-af4f-cd93a828e255 req-c24927a9-bbf1-4ccd-b968-212070521030 tempest-ServerActionsTestOtherA-581085483 None] attachment_update completed successfully. Aug 27 03:44:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c61aee85-ed14-4a0c-9239-fb228627af87 tempest-VolumesGetTest-1252533602 None] Acquiring lock "cinder-6593b8da-4166-4a51-94ea-87950d08846b-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:44:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c61aee85-ed14-4a0c-9239-fb228627af87 tempest-VolumesGetTest-1252533602 None] Lock "cinder-6593b8da-4166-4a51-94ea-87950d08846b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:44:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c61aee85-ed14-4a0c-9239-fb228627af87 tempest-VolumesGetTest-1252533602 None] Acquiring lock "cinder-quobyte-6593b8da-4166-4a51-94ea-87950d08846b" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:44:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c61aee85-ed14-4a0c-9239-fb228627af87 tempest-VolumesGetTest-1252533602 None] Lock "cinder-quobyte-6593b8da-4166-4a51-94ea-87950d08846b" acquired by "delete_volume" :: waited 0.021s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:44:06 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca12603-c052-43a6-bb58-45a993f873a5]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:44:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c61aee85-ed14-4a0c-9239-fb228627af87 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6593b8da-4166-4a51-94ea-87950d08846b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:06 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6593b8da-4166-4a51-94ea-87950d08846b Aug 27 03:44:06 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:07 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c61aee85-ed14-4a0c-9239-fb228627af87 tempest-VolumesGetTest-1252533602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6593b8da-4166-4a51-94ea-87950d08846b" returned: 0 in 0.426s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c61aee85-ed14-4a0c-9239-fb228627af87 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6593b8da-4166-4a51-94ea-87950d08846b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:07 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6593b8da-4166-4a51-94ea-87950d08846b Aug 27 03:44:07 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:07 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c61aee85-ed14-4a0c-9239-fb228627af87 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6593b8da-4166-4a51-94ea-87950d08846b" returned: 0 in 0.267s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c61aee85-ed14-4a0c-9239-fb228627af87 tempest-VolumesGetTest-1252533602 None] Lock "cinder-quobyte-6593b8da-4166-4a51-94ea-87950d08846b" released by "delete_volume" :: held 0.748s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:44:07 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-c61aee85-ed14-4a0c-9239-fb228627af87 tempest-VolumesGetTest-1252533602 None] Created reservations ['eaa6166f-5a9b-4e9b-8caf-50b9cc9ca4da', 'f56b5bf4-378c-477d-bfb6-702e9a8e2748', '74fae2c0-31c2-4cce-9cc0-2f6af0cba6fa', 'bf7f13f4-2861-41cc-98d0-734c46150a8e'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:44:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c61aee85-ed14-4a0c-9239-fb228627af87 tempest-VolumesGetTest-1252533602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:44:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c61aee85-ed14-4a0c-9239-fb228627af87 tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:44:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c61aee85-ed14-4a0c-9239-fb228627af87 tempest-VolumesGetTest-1252533602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:44:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c61aee85-ed14-4a0c-9239-fb228627af87 tempest-VolumesGetTest-1252533602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:44:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c61aee85-ed14-4a0c-9239-fb228627af87 tempest-VolumesGetTest-1252533602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:44:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c61aee85-ed14-4a0c-9239-fb228627af87 tempest-VolumesGetTest-1252533602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:07 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:44:07 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:07 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c61aee85-ed14-4a0c-9239-fb228627af87 tempest-VolumesGetTest-1252533602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.300s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:07 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-c61aee85-ed14-4a0c-9239-fb228627af87 tempest-VolumesGetTest-1252533602 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:44:07 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-c61aee85-ed14-4a0c-9239-fb228627af87 tempest-VolumesGetTest-1252533602 None] Deleted volume successfully. Aug 27 03:44:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c61aee85-ed14-4a0c-9239-fb228627af87 tempest-VolumesGetTest-1252533602 None] Lock "cinder-6593b8da-4166-4a51-94ea-87950d08846b-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:44:10 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-25e4ee6f-af82-4fa1-8324-5a898f17a58d req-0fdb485b-616c-4bf4-97c2-e0e5e4a2bbee tempest-ServerActionsTestOtherA-581085483 None] Terminate volume connection completed successfully. Aug 27 03:44:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-25e4ee6f-af82-4fa1-8324-5a898f17a58d req-0fdb485b-616c-4bf4-97c2-e0e5e4a2bbee tempest-ServerActionsTestOtherA-581085483 None] Deleting attachment 102d406f-d61a-48bd-bba1-4abc7a3fca08. {{(pid=94328) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 27 03:44:10 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:44:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Flow 'volume_create_manager' (8fab02ac-e247-4c51-891a-d331482bad32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:44:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db50ada-afac-4956-8ea8-6af6ea4a85e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db50ada-afac-4956-8ea8-6af6ea4a85e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1668049965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50be3fe-b793-4f35-91d4-4941874e870c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f3fb4bd8d7465b82c18cfd8fece208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:44:10Z,use_quota=True,user_id='51dc585b1b3240f9884aae1d03e2e63b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c0c7cb3-c014-45a4-a724-5ee92a63f54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c0c7cb3-c014-45a4-a724-5ee92a63f54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605b244a-18ed-4663-88f2-0eb3a4cd38e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605b244a-18ed-4663-88f2-0eb3a4cd38e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd50be3fe-b793-4f35-91d4-4941874e870c', 'volume_name': 'volume-d50be3fe-b793-4f35-91d4-4941874e870c', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd72a5c-ea71-4117-905a-a3fa50cc6070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd72a5c-ea71-4117-905a-a3fa50cc6070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b19e18f-9976-4b8a-8d0f-9e3f38b75eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:10 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Volume d50be3fe-b793-4f35-91d4-4941874e870c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d50be3fe-b793-4f35-91d4-4941874e870c', 'volume_size': 1} Aug 27 03:44:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:44:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:44:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1668049965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50be3fe-b793-4f35-91d4-4941874e870c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f3fb4bd8d7465b82c18cfd8fece208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:44:10Z,use_quota=True,user_id='51dc585b1b3240f9884aae1d03e2e63b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:44:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Creating volume d50be3fe-b793-4f35-91d4-4941874e870c {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:44:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:44:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:44:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:44:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:44:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:44:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:44:10 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:44:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d50be3fe-b793-4f35-91d4-4941874e870c 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:10 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d50be3fe-b793-4f35-91d4-4941874e870c 1073741824 Aug 27 03:44:10 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:11 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d50be3fe-b793-4f35-91d4-4941874e870c 1073741824" returned: 0 in 1.168s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d50be3fe-b793-4f35-91d4-4941874e870c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-25e4ee6f-af82-4fa1-8324-5a898f17a58d req-e04d7251-203d-4c89-bfac-0919a18cc1e5 tempest-ServerActionsTestOtherA-581085483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:44:11 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d50be3fe-b793-4f35-91d4-4941874e870c Aug 27 03:44:11 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:12 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d50be3fe-b793-4f35-91d4-4941874e870c" returned: 0 in 0.531s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:44:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.900s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:44:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-25e4ee6f-af82-4fa1-8324-5a898f17a58d req-e04d7251-203d-4c89-bfac-0919a18cc1e5 tempest-ServerActionsTestOtherA-581085483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.505s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:44:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b19e18f-9976-4b8a-8d0f-9e3f38b75eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d50be3fe-b793-4f35-91d4-4941874e870c', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (820cf474-fec7-4bd8-9a1d-82c41ca5ef7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-25e4ee6f-af82-4fa1-8324-5a898f17a58d req-e04d7251-203d-4c89-bfac-0919a18cc1e5 tempest-ServerActionsTestOtherA-581085483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.086s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:44:12 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Volume volume-d50be3fe-b793-4f35-91d4-4941874e870c (d50be3fe-b793-4f35-91d4-4941874e870c): created successfully Aug 27 03:44:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (820cf474-fec7-4bd8-9a1d-82c41ca5ef7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Flow 'volume_create_manager' (8fab02ac-e247-4c51-891a-d331482bad32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:44:12 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-66027547-7be4-4e73-ba61-e796cd70d815 tempest-AttachVolumeNegativeTest-1215284800 None] Created volume successfully. Aug 27 03:44:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-25e4ee6f-af82-4fa1-8324-5a898f17a58d req-e04d7251-203d-4c89-bfac-0919a18cc1e5 tempest-ServerActionsTestOtherA-581085483 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac', 'name': 'volume-30612b6f-c78d-4217-a7a3-84d9cb3e6d97', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4e243c1-22b1-45b9-9d9a-5cfb2c143c84', 'enforce_multipath': True} {{(pid=94328) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 27 03:44:12 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-25e4ee6f-af82-4fa1-8324-5a898f17a58d req-e04d7251-203d-4c89-bfac-0919a18cc1e5 tempest-ServerActionsTestOtherA-581085483 None] attachment_update completed successfully. Aug 27 03:44:13 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:44:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Flow 'volume_create_manager' (bdf9a91a-dc49-422b-88fe-d7bea0182c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:44:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a00552a7-e25f-4c80-af0a-8ec666527ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a00552a7-e25f-4c80-af0a-8ec666527ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1691588274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0657c0d4-280a-4edd-ae5e-8fb732fc12c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='583867ab7bf7422cad953685e023c2c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:44:13Z,use_quota=True,user_id='c582effc387d4cbda6807ac87c82da87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341c9b4d-b3c9-43cf-a4a9-8b1a1961efba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341c9b4d-b3c9-43cf-a4a9-8b1a1961efba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc0d2ff-b0ae-4b17-9849-3c500c62dd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc0d2ff-b0ae-4b17-9849-3c500c62dd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0657c0d4-280a-4edd-ae5e-8fb732fc12c1', 'volume_name': 'volume-0657c0d4-280a-4edd-ae5e-8fb732fc12c1', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f8ba71-363f-40d3-9993-20ba93108622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f8ba71-363f-40d3-9993-20ba93108622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5f6300e-69a8-4d27-8c31-d257c939cddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:13 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Volume 0657c0d4-280a-4edd-ae5e-8fb732fc12c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0657c0d4-280a-4edd-ae5e-8fb732fc12c1', 'volume_size': 1} Aug 27 03:44:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:44:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:44:13 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1691588274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0657c0d4-280a-4edd-ae5e-8fb732fc12c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='583867ab7bf7422cad953685e023c2c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:44:13Z,use_quota=True,user_id='c582effc387d4cbda6807ac87c82da87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:44:13 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Creating volume 0657c0d4-280a-4edd-ae5e-8fb732fc12c1 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:44:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:44:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:44:13 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:44:13 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:44:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:44:13 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:44:13 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:44:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657c0d4-280a-4edd-ae5e-8fb732fc12c1 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:13 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657c0d4-280a-4edd-ae5e-8fb732fc12c1 1073741824 Aug 27 03:44:13 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-47f7fd70-cde7-4b09-8174-ce2243f95cc8 req-ca778515-40f6-494e-94a4-5c8cde51bb99 tempest-AttachVolumeNegativeTest-1215284800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:44:14 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657c0d4-280a-4edd-ae5e-8fb732fc12c1 1073741824" returned: 0 in 0.942s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657c0d4-280a-4edd-ae5e-8fb732fc12c1 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:14 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657c0d4-280a-4edd-ae5e-8fb732fc12c1 Aug 27 03:44:14 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:14 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657c0d4-280a-4edd-ae5e-8fb732fc12c1" returned: 0 in 0.361s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:44:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:44:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-47f7fd70-cde7-4b09-8174-ce2243f95cc8 req-ca778515-40f6-494e-94a4-5c8cde51bb99 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.575s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:44:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5f6300e-69a8-4d27-8c31-d257c939cddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0657c0d4-280a-4edd-ae5e-8fb732fc12c1', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b3b688a-5668-45cc-8c5d-23991a702989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:14 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:44:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:44:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:44:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:44:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:44:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:44:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:14 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Volume volume-0657c0d4-280a-4edd-ae5e-8fb732fc12c1 (0657c0d4-280a-4edd-ae5e-8fb732fc12c1): created successfully Aug 27 03:44:14 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:44:14 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b3b688a-5668-45cc-8c5d-23991a702989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Flow 'volume_create_manager' (bdf9a91a-dc49-422b-88fe-d7bea0182c0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:44:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-47f7fd70-cde7-4b09-8174-ce2243f95cc8 req-ca778515-40f6-494e-94a4-5c8cde51bb99 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.242s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:44:15 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-205fdd24-8f0d-44a4-b11a-4e92b89bb1e8 tempest-VolumesNegativeTest-952307201 None] Created volume successfully. Aug 27 03:44:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-47f7fd70-cde7-4b09-8174-ce2243f95cc8 req-ca778515-40f6-494e-94a4-5c8cde51bb99 tempest-AttachVolumeNegativeTest-1215284800 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac', 'name': 'volume-d50be3fe-b793-4f35-91d4-4941874e870c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eae5020a-6d2a-4f06-b8e3-1e65334ed30c', 'enforce_multipath': True} {{(pid=94328) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 27 03:44:15 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-47f7fd70-cde7-4b09-8174-ce2243f95cc8 req-ca778515-40f6-494e-94a4-5c8cde51bb99 tempest-AttachVolumeNegativeTest-1215284800 None] attachment_update completed successfully. Aug 27 03:44:16 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 1.180s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:16 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:44:16 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager._thread_info {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:44:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread count: 28 {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 03:44:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread info: [<_MainThread(MainThread, started 134250325188736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 03:44:25 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:UPDATE=75,cinder:INSERT=18,cinder:DELETE=7,cinder:SELECT=62 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:44:25 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=37,cinder:INSERT=6,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:44:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1533aed6-9ac7-497b-8ffa-19ef1bd996e6 tempest-AttachVolumeShelveTestJSON-701099279 None] Acquiring lock "cinder-eb506456-d08d-4f4d-81ff-bd95378c590c-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:44:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1533aed6-9ac7-497b-8ffa-19ef1bd996e6 tempest-AttachVolumeShelveTestJSON-701099279 None] Lock "cinder-eb506456-d08d-4f4d-81ff-bd95378c590c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:44:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1533aed6-9ac7-497b-8ffa-19ef1bd996e6 tempest-AttachVolumeShelveTestJSON-701099279 None] Acquiring lock "cinder-quobyte-eb506456-d08d-4f4d-81ff-bd95378c590c" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:44:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1533aed6-9ac7-497b-8ffa-19ef1bd996e6 tempest-AttachVolumeShelveTestJSON-701099279 None] Lock "cinder-quobyte-eb506456-d08d-4f4d-81ff-bd95378c590c" acquired by "delete_volume" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:44:43 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[625e8073-6195-4296-8283-6544b0f92332]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:44:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1533aed6-9ac7-497b-8ffa-19ef1bd996e6 tempest-AttachVolumeShelveTestJSON-701099279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eb506456-d08d-4f4d-81ff-bd95378c590c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:43 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eb506456-d08d-4f4d-81ff-bd95378c590c Aug 27 03:44:43 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:44 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1533aed6-9ac7-497b-8ffa-19ef1bd996e6 tempest-AttachVolumeShelveTestJSON-701099279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eb506456-d08d-4f4d-81ff-bd95378c590c" returned: 0 in 0.568s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1533aed6-9ac7-497b-8ffa-19ef1bd996e6 tempest-AttachVolumeShelveTestJSON-701099279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eb506456-d08d-4f4d-81ff-bd95378c590c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:44 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eb506456-d08d-4f4d-81ff-bd95378c590c Aug 27 03:44:44 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0aca636d-19ec-4a86-96eb-ae636a6a9c62 tempest-VolumesNegativeTest-952307201 None] Acquiring lock "cinder-0657c0d4-280a-4edd-ae5e-8fb732fc12c1-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:44:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0aca636d-19ec-4a86-96eb-ae636a6a9c62 tempest-VolumesNegativeTest-952307201 None] Lock "cinder-0657c0d4-280a-4edd-ae5e-8fb732fc12c1-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:44:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0aca636d-19ec-4a86-96eb-ae636a6a9c62 tempest-VolumesNegativeTest-952307201 None] Acquiring lock "cinder-quobyte-0657c0d4-280a-4edd-ae5e-8fb732fc12c1" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:44:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0aca636d-19ec-4a86-96eb-ae636a6a9c62 tempest-VolumesNegativeTest-952307201 None] Lock "cinder-quobyte-0657c0d4-280a-4edd-ae5e-8fb732fc12c1" acquired by "delete_volume" :: waited 0.026s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:44:44 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0116e0f-b0f0-4882-866e-019ca0f582ef]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:44:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0aca636d-19ec-4a86-96eb-ae636a6a9c62 tempest-VolumesNegativeTest-952307201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657c0d4-280a-4edd-ae5e-8fb732fc12c1 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:44 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1533aed6-9ac7-497b-8ffa-19ef1bd996e6 tempest-AttachVolumeShelveTestJSON-701099279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eb506456-d08d-4f4d-81ff-bd95378c590c" returned: 0 in 0.421s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1533aed6-9ac7-497b-8ffa-19ef1bd996e6 tempest-AttachVolumeShelveTestJSON-701099279 None] Lock "cinder-quobyte-eb506456-d08d-4f4d-81ff-bd95378c590c" released by "delete_volume" :: held 1.058s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:44:44 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657c0d4-280a-4edd-ae5e-8fb732fc12c1 Aug 27 03:44:44 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:44 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-1533aed6-9ac7-497b-8ffa-19ef1bd996e6 tempest-AttachVolumeShelveTestJSON-701099279 None] Created reservations ['395fe86e-32ae-4650-8f1f-13e0c58362bf', '53bc6076-e512-4bd4-91ad-279dccc57498', 'b8cd16b6-a531-44ee-abce-f6ff1874b7d3', 'd1f74d0f-c933-469f-8c4d-be4599995b59'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:44:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1533aed6-9ac7-497b-8ffa-19ef1bd996e6 tempest-AttachVolumeShelveTestJSON-701099279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:44:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1533aed6-9ac7-497b-8ffa-19ef1bd996e6 tempest-AttachVolumeShelveTestJSON-701099279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:44:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1533aed6-9ac7-497b-8ffa-19ef1bd996e6 tempest-AttachVolumeShelveTestJSON-701099279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:44:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1533aed6-9ac7-497b-8ffa-19ef1bd996e6 tempest-AttachVolumeShelveTestJSON-701099279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:44:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1533aed6-9ac7-497b-8ffa-19ef1bd996e6 tempest-AttachVolumeShelveTestJSON-701099279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:44:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1533aed6-9ac7-497b-8ffa-19ef1bd996e6 tempest-AttachVolumeShelveTestJSON-701099279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:44 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:44:44 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:45 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0aca636d-19ec-4a86-96eb-ae636a6a9c62 tempest-VolumesNegativeTest-952307201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657c0d4-280a-4edd-ae5e-8fb732fc12c1" returned: 0 in 0.537s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0aca636d-19ec-4a86-96eb-ae636a6a9c62 tempest-VolumesNegativeTest-952307201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657c0d4-280a-4edd-ae5e-8fb732fc12c1 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:45 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1533aed6-9ac7-497b-8ffa-19ef1bd996e6 tempest-AttachVolumeShelveTestJSON-701099279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.281s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:45 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-1533aed6-9ac7-497b-8ffa-19ef1bd996e6 tempest-AttachVolumeShelveTestJSON-701099279 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:44:45 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657c0d4-280a-4edd-ae5e-8fb732fc12c1 Aug 27 03:44:45 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:45 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-1533aed6-9ac7-497b-8ffa-19ef1bd996e6 tempest-AttachVolumeShelveTestJSON-701099279 None] Deleted volume successfully. Aug 27 03:44:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1533aed6-9ac7-497b-8ffa-19ef1bd996e6 tempest-AttachVolumeShelveTestJSON-701099279 None] Lock "cinder-eb506456-d08d-4f4d-81ff-bd95378c590c-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:44:45 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0aca636d-19ec-4a86-96eb-ae636a6a9c62 tempest-VolumesNegativeTest-952307201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657c0d4-280a-4edd-ae5e-8fb732fc12c1" returned: 0 in 0.337s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0aca636d-19ec-4a86-96eb-ae636a6a9c62 tempest-VolumesNegativeTest-952307201 None] Lock "cinder-quobyte-0657c0d4-280a-4edd-ae5e-8fb732fc12c1" released by "delete_volume" :: held 0.928s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:44:45 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-0aca636d-19ec-4a86-96eb-ae636a6a9c62 tempest-VolumesNegativeTest-952307201 None] Created reservations ['4f6be47f-d853-46a6-9353-5498c01f8cd1', 'e4563713-4834-43e2-bfdd-ec4c4e6f8f9e', '4a16c35e-05ad-4254-92b3-0be04ce27ac7', '0fa5cebd-ea48-4742-a765-67684b234f50'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:44:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0aca636d-19ec-4a86-96eb-ae636a6a9c62 tempest-VolumesNegativeTest-952307201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:44:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0aca636d-19ec-4a86-96eb-ae636a6a9c62 tempest-VolumesNegativeTest-952307201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:44:45 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0aca636d-19ec-4a86-96eb-ae636a6a9c62 tempest-VolumesNegativeTest-952307201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:44:45 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0aca636d-19ec-4a86-96eb-ae636a6a9c62 tempest-VolumesNegativeTest-952307201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:44:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0aca636d-19ec-4a86-96eb-ae636a6a9c62 tempest-VolumesNegativeTest-952307201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:44:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0aca636d-19ec-4a86-96eb-ae636a6a9c62 tempest-VolumesNegativeTest-952307201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:45 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:44:45 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:45 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0aca636d-19ec-4a86-96eb-ae636a6a9c62 tempest-VolumesNegativeTest-952307201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.288s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:45 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-0aca636d-19ec-4a86-96eb-ae636a6a9c62 tempest-VolumesNegativeTest-952307201 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:44:45 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-0aca636d-19ec-4a86-96eb-ae636a6a9c62 tempest-VolumesNegativeTest-952307201 None] Deleted volume successfully. Aug 27 03:44:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0aca636d-19ec-4a86-96eb-ae636a6a9c62 tempest-VolumesNegativeTest-952307201 None] Lock "cinder-0657c0d4-280a-4edd-ae5e-8fb732fc12c1-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:44:46 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-570fe74a-87e3-4f2d-a7ec-de6644751181 req-3c0f6ee2-6df2-4808-842c-0e2743791859 tempest-ServerActionsTestOtherA-581085483 None] Terminate volume connection completed successfully. Aug 27 03:44:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-570fe74a-87e3-4f2d-a7ec-de6644751181 req-3c0f6ee2-6df2-4808-842c-0e2743791859 tempest-ServerActionsTestOtherA-581085483 None] Deleting attachment a4e243c1-22b1-45b9-9d9a-5cfb2c143c84. {{(pid=94328) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 27 03:44:50 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:44:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Flow 'volume_create_manager' (9f2d4db0-1047-4850-b08a-f0ea52f41953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:44:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a758ce-96a8-4dff-9fcd-6ed8c7ebeb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a758ce-96a8-4dff-9fcd-6ed8c7ebeb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-659214781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e48db9e-19d5-48b9-aa2b-8fc98585d36f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ff87f24dca401b8eaf2504568de478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:44:50Z,use_quota=True,user_id='2b107652684c4858bd9655a6e030ce7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4fcb00-34d7-4498-a625-141c8dbbb207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4fcb00-34d7-4498-a625-141c8dbbb207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683f50f6-52e1-4fd3-b098-7ccbfe12b794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683f50f6-52e1-4fd3-b098-7ccbfe12b794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e48db9e-19d5-48b9-aa2b-8fc98585d36f', 'volume_name': 'volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f3a573-aa61-484a-a9ad-b816c6f3c11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f3a573-aa61-484a-a9ad-b816c6f3c11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5376fd79-3772-4233-9ae8-5e25abaaf1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:50 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Volume 5e48db9e-19d5-48b9-aa2b-8fc98585d36f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f', 'volume_size': 1} Aug 27 03:44:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:44:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:44:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-659214781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e48db9e-19d5-48b9-aa2b-8fc98585d36f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ff87f24dca401b8eaf2504568de478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:44:50Z,use_quota=True,user_id='2b107652684c4858bd9655a6e030ce7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:44:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Creating volume 5e48db9e-19d5-48b9-aa2b-8fc98585d36f {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:44:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:44:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:44:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:44:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:44:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:44:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:44:50 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:44:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:50 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f 1073741824 Aug 27 03:44:50 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:51 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f 1073741824" returned: 0 in 0.495s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:51 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f Aug 27 03:44:51 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:51 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f" returned: 0 in 0.347s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:44:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:44:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5376fd79-3772-4233-9ae8-5e25abaaf1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a439b148-adef-461b-b8f6-0d273efdc5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:51 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Volume volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f (5e48db9e-19d5-48b9-aa2b-8fc98585d36f): created successfully Aug 27 03:44:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a439b148-adef-461b-b8f6-0d273efdc5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Flow 'volume_create_manager' (9f2d4db0-1047-4850-b08a-f0ea52f41953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:44:51 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-ad2d51ee-c827-4e61-a958-5ee2df0deb39 tempest-VolumesSnapshotListTestJSON-1843389576 None] Created volume successfully. Aug 27 03:44:52 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:44:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Flow 'volume_create_manager' (acccee9f-7205-42b4-8ea9-4ed8770b41a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:44:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc34395c-441b-4890-ae89-aec068d56f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc34395c-441b-4890-ae89-aec068d56f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2056845495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b7a9a0-3130-4ed4-a73e-71a1d3debe56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38616f385fc04296b23fd6a2b2c48b4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:44:53Z,use_quota=True,user_id='69fb34fd7e7c46d683d0ccb268648d73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a5a2c3-3d7a-4250-9df3-3431a9c8fd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a5a2c3-3d7a-4250-9df3-3431a9c8fd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057fb557-ac42-4728-8713-bd26de404a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:52 devstack cinder-volume[94328]: DEBUG cinder.image.glance [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Creating Keystone auth plugin from conf {{(pid=94328) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 27 03:44:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-33b590d8-2bc8-4662-b263-5cc37579a023 tempest-VolumesSnapshotListTestJSON-1843389576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:44:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-33b590d8-2bc8-4662-b263-5cc37579a023 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:44:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-33b590d8-2bc8-4662-b263-5cc37579a023 tempest-VolumesSnapshotListTestJSON-1843389576 None] Creating offline snapshot bde7defd-b0c0-4f86-9e9b-d588a1e4902b of volume 5e48db9e-19d5-48b9-aa2b-8fc98585d36f {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:44:52 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1683a54-bebb-46f8-8f7a-07ce018a8a01]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:44:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-33b590d8-2bc8-4662-b263-5cc37579a023 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:53 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f Aug 27 03:44:53 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057fb557-ac42-4728-8713-bd26de404a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '81b7a9a0-3130-4ed4-a73e-71a1d3debe56', 'volume_name': 'volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56', 'volume_size': 1, 'image_id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9b1f4295d504303ad90dfddaa1fb97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'created_at': datetime.datetime(2026, 8, 27, 1, 33, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 33, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f226020c-e698-42bf-8a64-41bbbde77748/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3272b14a-d88d-4aad-a4a8-178122c796f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3272b14a-d88d-4aad-a4a8-178122c796f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8735d3eb-bf64-4720-bbc3-fc60f880c8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:53 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Volume 81b7a9a0-3130-4ed4-a73e-71a1d3debe56: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56', 'volume_size': 1, 'image_id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9b1f4295d504303ad90dfddaa1fb97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'created_at': datetime.datetime(2026, 8, 27, 1, 33, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 33, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f226020c-e698-42bf-8a64-41bbbde77748/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 27 03:44:53 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Trying to clone 81b7a9a0-3130-4ed4-a73e-71a1d3debe56 from image f226020c-e698-42bf-8a64-41bbbde77748 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}]). {{(pid=94328) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 27 03:44:53 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-33b590d8-2bc8-4662-b263-5cc37579a023 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f" returned: 0 in 0.427s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-33b590d8-2bc8-4662-b263-5cc37579a023 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:53 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b 1G Aug 27 03:44:53 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:53 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_c5r2be4cdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 27 03:44:53 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Image download 20.69 MB at 20.69 MB/s Aug 27 03:44:53 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25d0f11-cc85-488f-9689-b7c50f00ea99]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:44:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_c5r2be4cdevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:53 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_c5r2be4cdevstack@QuobyteHD Aug 27 03:44:53 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:53 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-33b590d8-2bc8-4662-b263-5cc37579a023 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b 1G" returned: 0 in 0.527s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-33b590d8-2bc8-4662-b263-5cc37579a023 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:53 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b Aug 27 03:44:53 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:54 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_c5r2be4cdevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:54 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Temporary image f226020c-e698-42bf-8a64-41bbbde77748 is fetched for user 69fb34fd7e7c46d683d0ccb268648d73. {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 27 03:44:54 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb95a22-b48d-4fb1-84e4-23724e951636]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:44:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_c5r2be4cdevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:54 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-33b590d8-2bc8-4662-b263-5cc37579a023 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b" returned: 0 in 0.353s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:54 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-33b590d8-2bc8-4662-b263-5cc37579a023 tempest-VolumesSnapshotListTestJSON-1843389576 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b is being set with open permissions: ugo+rw Aug 27 03:44:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-33b590d8-2bc8-4662-b263-5cc37579a023 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:54 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b Aug 27 03:44:54 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:54 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_c5r2be4cdevstack@QuobyteHD Aug 27 03:44:54 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:54 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_c5r2be4cdevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:44:54 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-33b590d8-2bc8-4662-b263-5cc37579a023 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b" returned: 0 in 0.269s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-33b590d8-2bc8-4662-b263-5cc37579a023 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:54 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.info Aug 27 03:44:54 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:54 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-33b590d8-2bc8-4662-b263-5cc37579a023 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.info" returned: 0 in 0.256s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:54 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-33b590d8-2bc8-4662-b263-5cc37579a023 tempest-VolumesSnapshotListTestJSON-1843389576 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.info is being set with open permissions: ugo+rw Aug 27 03:44:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-33b590d8-2bc8-4662-b263-5cc37579a023 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:54 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.info Aug 27 03:44:54 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:55 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-33b590d8-2bc8-4662-b263-5cc37579a023 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.info" returned: 0 in 0.262s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-33b590d8-2bc8-4662-b263-5cc37579a023 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.194s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:44:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.598s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:44:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2056845495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b7a9a0-3130-4ed4-a73e-71a1d3debe56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38616f385fc04296b23fd6a2b2c48b4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:44:53Z,use_quota=True,user_id='69fb34fd7e7c46d683d0ccb268648d73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:44:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Creating volume 81b7a9a0-3130-4ed4-a73e-71a1d3debe56 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:44:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:44:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:44:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:44:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:44:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:44:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:44:55 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:44:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:55 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56 1073741824 Aug 27 03:44:55 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:55 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-33b590d8-2bc8-4662-b263-5cc37579a023 tempest-VolumesSnapshotListTestJSON-1843389576 None] Create snapshot completed successfully Aug 27 03:44:55 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56 1073741824" returned: 0 in 0.483s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:55 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56 Aug 27 03:44:55 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:56 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56" returned: 0 in 0.351s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Attempting download of f226020c-e698-42bf-8a64-41bbbde77748 ((None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}])) to volume 81b7a9a0-3130-4ed4-a73e-71a1d3debe56. {{(pid=94328) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ff709a-c14e-4896-baf1-b4ab67ebcc6f]: (4, 'raw') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_apkql1ia {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:56 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_apkql1ia Aug 27 03:44:56 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-aed145f5-f06b-4961-909f-1df93f94545a tempest-VolumesSnapshotListTestJSON-1843389576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-aed145f5-f06b-4961-909f-1df93f94545a tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-aed145f5-f06b-4961-909f-1df93f94545a tempest-VolumesSnapshotListTestJSON-1843389576 None] Creating offline snapshot 6f7d2b87-8dfa-497e-ae07-b84c8f15a045 of volume 5e48db9e-19d5-48b9-aa2b-8fc98585d36f {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f22e5e9-d014-4199-844a-11cb860790eb]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Flow 'volume_create_manager' (4db64d89-ab4e-4ebc-9e7d-554cb68703c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc020e3e-df6e-4b2a-a74c-3d2fa9ffefdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-aed145f5-f06b-4961-909f-1df93f94545a tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc020e3e-df6e-4b2a-a74c-3d2fa9ffefdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2106240928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96661636-5ec5-4bb5-8155-c30ae999506f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a18f90446ac548d6aebbd922fa09868a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:44:56Z,use_quota=True,user_id='f4dfaf7dcd3a41ac9e9eb6df50c6a7fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (609f43c6-c64e-4eb0-858a-dce032191bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (609f43c6-c64e-4eb0-858a-dce032191bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (316b657b-aa31-4d22-a8f3-7dc6024660c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (316b657b-aa31-4d22-a8f3-7dc6024660c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96661636-5ec5-4bb5-8155-c30ae999506f', 'volume_name': 'volume-96661636-5ec5-4bb5-8155-c30ae999506f', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d29d328-5be2-4d0d-9a58-a383c4b6a447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d29d328-5be2-4d0d-9a58-a383c4b6a447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54c03ea-14c1-4999-b6bf-36bc04fee626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:56 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Volume 96661636-5ec5-4bb5-8155-c30ae999506f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96661636-5ec5-4bb5-8155-c30ae999506f', 'volume_size': 1} Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:44:56 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_apkql1ia" returned: 0 in 0.430s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_apkql1ia {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:56 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b Aug 27 03:44:56 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:56 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_apkql1ia Aug 27 03:44:56 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:56 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-aed145f5-f06b-4961-909f-1df93f94545a tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b" returned: 0 in 0.421s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-aed145f5-f06b-4961-909f-1df93f94545a tempest-VolumesSnapshotListTestJSON-1843389576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:44:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-aed145f5-f06b-4961-909f-1df93f94545a tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:56 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045 1G Aug 27 03:44:56 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:57 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_apkql1ia" returned: 1 in 0.391s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_apkql1ia' failed. Not Retrying. {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 27 03:44:57 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce43d31a-681a-4501-8fb6-afa6ec03f8a4]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:44:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_c5r2be4cdevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:57 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_c5r2be4cdevstack@QuobyteHD Aug 27 03:44:57 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:57 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_c5r2be4cdevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:57 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] f226020c-e698-42bf-8a64-41bbbde77748 was qcow2, converting to qcow2 {{(pid=94328) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 27 03:44:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_c5r2be4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:57 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_c5r2be4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56 Aug 27 03:44:57 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:57 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-aed145f5-f06b-4961-909f-1df93f94545a tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045 1G" returned: 0 in 0.508s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-aed145f5-f06b-4961-909f-1df93f94545a tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:57 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045 Aug 27 03:44:57 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:57 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-aed145f5-f06b-4961-909f-1df93f94545a tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045" returned: 0 in 0.324s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:57 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-aed145f5-f06b-4961-909f-1df93f94545a tempest-VolumesSnapshotListTestJSON-1843389576 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045 is being set with open permissions: ugo+rw Aug 27 03:44:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-aed145f5-f06b-4961-909f-1df93f94545a tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:57 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045 Aug 27 03:44:57 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:58 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-aed145f5-f06b-4961-909f-1df93f94545a tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045" returned: 0 in 0.285s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-aed145f5-f06b-4961-909f-1df93f94545a tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.674s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:44:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.515s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:44:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2106240928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96661636-5ec5-4bb5-8155-c30ae999506f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a18f90446ac548d6aebbd922fa09868a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:44:56Z,use_quota=True,user_id='f4dfaf7dcd3a41ac9e9eb6df50c6a7fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:44:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Creating volume 96661636-5ec5-4bb5-8155-c30ae999506f {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:44:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:44:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:44:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:44:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:44:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:44:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:44:58 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:44:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96661636-5ec5-4bb5-8155-c30ae999506f 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:58 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96661636-5ec5-4bb5-8155-c30ae999506f 1073741824 Aug 27 03:44:58 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:58 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-aed145f5-f06b-4961-909f-1df93f94545a tempest-VolumesSnapshotListTestJSON-1843389576 None] Create snapshot completed successfully Aug 27 03:44:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f344b9d8-e58e-4433-a0a3-f2153cad1fd8 tempest-VolumesSnapshotListTestJSON-1843389576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:44:58 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96661636-5ec5-4bb5-8155-c30ae999506f 1073741824" returned: 0 in 0.525s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96661636-5ec5-4bb5-8155-c30ae999506f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:58 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96661636-5ec5-4bb5-8155-c30ae999506f Aug 27 03:44:58 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:58 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96661636-5ec5-4bb5-8155-c30ae999506f" returned: 0 in 0.262s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:44:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:44:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f344b9d8-e58e-4433-a0a3-f2153cad1fd8 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.350s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:44:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54c03ea-14c1-4999-b6bf-36bc04fee626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96661636-5ec5-4bb5-8155-c30ae999506f', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aedf9a5f-fd5b-4d3c-841a-6d4beafd4374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-f344b9d8-e58e-4433-a0a3-f2153cad1fd8 tempest-VolumesSnapshotListTestJSON-1843389576 None] Creating offline snapshot 8593dceb-b8f6-4b1f-b484-d8f00f3fbfca of volume 5e48db9e-19d5-48b9-aa2b-8fc98585d36f {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:44:59 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Volume volume-96661636-5ec5-4bb5-8155-c30ae999506f (96661636-5ec5-4bb5-8155-c30ae999506f): created successfully Aug 27 03:44:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aedf9a5f-fd5b-4d3c-841a-6d4beafd4374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Flow 'volume_create_manager' (4db64d89-ab4e-4ebc-9e7d-554cb68703c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:44:59 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29fd307-0091-44a2-8d40-ebfa8787085f]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:44:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f344b9d8-e58e-4433-a0a3-f2153cad1fd8 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:59 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-1a74f735-ae65-4783-beb3-b80700f9710d req-e6b5a639-4f0c-483e-b3bb-beba6eaf89b1 tempest-VolumesGetTestJSON-1178211517 None] Created volume successfully. Aug 27 03:44:59 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045 Aug 27 03:44:59 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:59 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_c5r2be4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56" returned: 0 in 1.881s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:59 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_c5r2be4cdevstack@QuobyteHD, size 112.00 MB, duration 1.88 sec, destination /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56 {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:44:59 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Converted 112.00 MB image at 59.51 MB/s Aug 27 03:44:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:59 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56 1G Aug 27 03:44:59 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:59 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f344b9d8-e58e-4433-a0a3-f2153cad1fd8 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045" returned: 0 in 0.403s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-f344b9d8-e58e-4433-a0a3-f2153cad1fd8 tempest-VolumesSnapshotListTestJSON-1843389576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:44:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f344b9d8-e58e-4433-a0a3-f2153cad1fd8 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.8593dceb-b8f6-4b1f-b484-d8f00f3fbfca 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:44:59 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.8593dceb-b8f6-4b1f-b484-d8f00f3fbfca 1G Aug 27 03:44:59 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:44:59 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Aug 27 03:44:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56 1G" returned: 0 in 0.428s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:44:59 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Downloaded image f226020c-e698-42bf-8a64-41bbbde77748 ((None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}])) to volume 81b7a9a0-3130-4ed4-a73e-71a1d3debe56 successfully. {{(pid=94328) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 27 03:44:59 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Temporary image f226020c-e698-42bf-8a64-41bbbde77748 for user 69fb34fd7e7c46d683d0ccb268648d73 is deleted. {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 27 03:44:59 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Marking volume 81b7a9a0-3130-4ed4-a73e-71a1d3debe56 as bootable. {{(pid=94328) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 27 03:44:59 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Copying metadata from image f226020c-e698-42bf-8a64-41bbbde77748 to 81b7a9a0-3130-4ed4-a73e-71a1d3debe56. {{(pid=94328) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 27 03:44:59 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Creating volume glance metadata for volume 81b7a9a0-3130-4ed4-a73e-71a1d3debe56 backed by image f226020c-e698-42bf-8a64-41bbbde77748 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94328) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 27 03:44:59 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-0f84a556-249d-4a0e-b9b2-6be9ac9f3258 req-2610988b-b78e-45df-81ce-7452cbdbf443 tempest-VolumesGetTestJSON-1178211517 None] Acquiring lock "cinder-96661636-5ec5-4bb5-8155-c30ae999506f-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:44:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8735d3eb-bf64-4720-bbc3-fc60f880c8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56', 'volume_size': 1, 'image_id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9b1f4295d504303ad90dfddaa1fb97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'created_at': datetime.datetime(2026, 8, 27, 1, 33, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 33, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f226020c-e698-42bf-8a64-41bbbde77748/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340762c2-2a84-4ed9-91a4-ed26fc086a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:44:59 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-0f84a556-249d-4a0e-b9b2-6be9ac9f3258 req-2610988b-b78e-45df-81ce-7452cbdbf443 tempest-VolumesGetTestJSON-1178211517 None] Lock "cinder-96661636-5ec5-4bb5-8155-c30ae999506f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:44:59 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Volume volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56 (81b7a9a0-3130-4ed4-a73e-71a1d3debe56): created successfully Aug 27 03:44:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340762c2-2a84-4ed9-91a4-ed26fc086a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:44:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Flow 'volume_create_manager' (acccee9f-7205-42b4-8ea9-4ed8770b41a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:45:00 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-91c4a026-5f1b-414c-9dfe-418aca770f40 tempest-ServerActionsTestOtherA-581085483 None] Created volume successfully. Aug 27 03:45:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-0f84a556-249d-4a0e-b9b2-6be9ac9f3258 req-2610988b-b78e-45df-81ce-7452cbdbf443 tempest-VolumesGetTestJSON-1178211517 None] Acquiring lock "cinder-quobyte-96661636-5ec5-4bb5-8155-c30ae999506f" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:45:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-0f84a556-249d-4a0e-b9b2-6be9ac9f3258 req-2610988b-b78e-45df-81ce-7452cbdbf443 tempest-VolumesGetTestJSON-1178211517 None] Lock "cinder-quobyte-96661636-5ec5-4bb5-8155-c30ae999506f" acquired by "delete_volume" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:45:00 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5e5954-63f4-48c6-8d0c-d2e679ac2d36]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:45:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-0f84a556-249d-4a0e-b9b2-6be9ac9f3258 req-2610988b-b78e-45df-81ce-7452cbdbf443 tempest-VolumesGetTestJSON-1178211517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96661636-5ec5-4bb5-8155-c30ae999506f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:00 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96661636-5ec5-4bb5-8155-c30ae999506f Aug 27 03:45:00 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:00 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f344b9d8-e58e-4433-a0a3-f2153cad1fd8 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.8593dceb-b8f6-4b1f-b484-d8f00f3fbfca 1G" returned: 0 in 0.744s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f344b9d8-e58e-4433-a0a3-f2153cad1fd8 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.8593dceb-b8f6-4b1f-b484-d8f00f3fbfca {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:00 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.8593dceb-b8f6-4b1f-b484-d8f00f3fbfca Aug 27 03:45:00 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:00 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-0f84a556-249d-4a0e-b9b2-6be9ac9f3258 req-2610988b-b78e-45df-81ce-7452cbdbf443 tempest-VolumesGetTestJSON-1178211517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96661636-5ec5-4bb5-8155-c30ae999506f" returned: 0 in 0.547s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-0f84a556-249d-4a0e-b9b2-6be9ac9f3258 req-2610988b-b78e-45df-81ce-7452cbdbf443 tempest-VolumesGetTestJSON-1178211517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96661636-5ec5-4bb5-8155-c30ae999506f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:00 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96661636-5ec5-4bb5-8155-c30ae999506f Aug 27 03:45:00 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:00 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f344b9d8-e58e-4433-a0a3-f2153cad1fd8 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.8593dceb-b8f6-4b1f-b484-d8f00f3fbfca" returned: 0 in 0.486s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:00 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-f344b9d8-e58e-4433-a0a3-f2153cad1fd8 tempest-VolumesSnapshotListTestJSON-1843389576 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.8593dceb-b8f6-4b1f-b484-d8f00f3fbfca is being set with open permissions: ugo+rw Aug 27 03:45:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f344b9d8-e58e-4433-a0a3-f2153cad1fd8 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.8593dceb-b8f6-4b1f-b484-d8f00f3fbfca {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:00 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.8593dceb-b8f6-4b1f-b484-d8f00f3fbfca Aug 27 03:45:00 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:00 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-0f84a556-249d-4a0e-b9b2-6be9ac9f3258 req-2610988b-b78e-45df-81ce-7452cbdbf443 tempest-VolumesGetTestJSON-1178211517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96661636-5ec5-4bb5-8155-c30ae999506f" returned: 0 in 0.350s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-0f84a556-249d-4a0e-b9b2-6be9ac9f3258 req-2610988b-b78e-45df-81ce-7452cbdbf443 tempest-VolumesGetTestJSON-1178211517 None] Lock "cinder-quobyte-96661636-5ec5-4bb5-8155-c30ae999506f" released by "delete_volume" :: held 0.945s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:45:01 devstack cinder-volume[94328]: DEBUG cinder.quota [req-0f84a556-249d-4a0e-b9b2-6be9ac9f3258 req-2610988b-b78e-45df-81ce-7452cbdbf443 tempest-VolumesGetTestJSON-1178211517 None] Created reservations ['d2ac54e2-4dac-4745-a5b8-96e492c3129e', '0db23ad1-2fa2-43bf-8041-5d45aaa330fb', 'af63b297-0b07-4daa-b4da-d276e7954882', '3cc10687-91a6-410b-9df5-c60651437209'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:45:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-0f84a556-249d-4a0e-b9b2-6be9ac9f3258 req-2610988b-b78e-45df-81ce-7452cbdbf443 tempest-VolumesGetTestJSON-1178211517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:45:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-0f84a556-249d-4a0e-b9b2-6be9ac9f3258 req-2610988b-b78e-45df-81ce-7452cbdbf443 tempest-VolumesGetTestJSON-1178211517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:45:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [req-0f84a556-249d-4a0e-b9b2-6be9ac9f3258 req-2610988b-b78e-45df-81ce-7452cbdbf443 tempest-VolumesGetTestJSON-1178211517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:45:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [req-0f84a556-249d-4a0e-b9b2-6be9ac9f3258 req-2610988b-b78e-45df-81ce-7452cbdbf443 tempest-VolumesGetTestJSON-1178211517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:45:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-0f84a556-249d-4a0e-b9b2-6be9ac9f3258 req-2610988b-b78e-45df-81ce-7452cbdbf443 tempest-VolumesGetTestJSON-1178211517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:45:01 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-0f84a556-249d-4a0e-b9b2-6be9ac9f3258 req-2610988b-b78e-45df-81ce-7452cbdbf443 tempest-VolumesGetTestJSON-1178211517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f344b9d8-e58e-4433-a0a3-f2153cad1fd8 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.8593dceb-b8f6-4b1f-b484-d8f00f3fbfca" returned: 0 in 0.467s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:01 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:45:01 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f344b9d8-e58e-4433-a0a3-f2153cad1fd8 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.293s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:45:01 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f344b9d8-e58e-4433-a0a3-f2153cad1fd8 tempest-VolumesSnapshotListTestJSON-1843389576 None] Create snapshot completed successfully Aug 27 03:45:01 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-0f84a556-249d-4a0e-b9b2-6be9ac9f3258 req-2610988b-b78e-45df-81ce-7452cbdbf443 tempest-VolumesGetTestJSON-1178211517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.493s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:01 devstack cinder-volume[94328]: DEBUG cinder.manager [req-0f84a556-249d-4a0e-b9b2-6be9ac9f3258 req-2610988b-b78e-45df-81ce-7452cbdbf443 tempest-VolumesGetTestJSON-1178211517 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:45:01 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-0f84a556-249d-4a0e-b9b2-6be9ac9f3258 req-2610988b-b78e-45df-81ce-7452cbdbf443 tempest-VolumesGetTestJSON-1178211517 None] Deleted volume successfully. Aug 27 03:45:01 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-0f84a556-249d-4a0e-b9b2-6be9ac9f3258 req-2610988b-b78e-45df-81ce-7452cbdbf443 tempest-VolumesGetTestJSON-1178211517 None] Lock "cinder-96661636-5ec5-4bb5-8155-c30ae999506f-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:45:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8e9ff207-a166-4a3f-8ffd-146254700803 tempest-VolumesSnapshotListTestJSON-1843389576 None] Acquiring lock "cinder-8593dceb-b8f6-4b1f-b484-d8f00f3fbfca-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:45:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8e9ff207-a166-4a3f-8ffd-146254700803 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "cinder-8593dceb-b8f6-4b1f-b484-d8f00f3fbfca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:45:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8e9ff207-a166-4a3f-8ffd-146254700803 tempest-VolumesSnapshotListTestJSON-1843389576 None] Acquiring lock "cinder-quobyte-5e48db9e-19d5-48b9-aa2b-8fc98585d36f" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:45:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8e9ff207-a166-4a3f-8ffd-146254700803 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "cinder-quobyte-5e48db9e-19d5-48b9-aa2b-8fc98585d36f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:45:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8e9ff207-a166-4a3f-8ffd-146254700803 tempest-VolumesSnapshotListTestJSON-1843389576 None] Acquiring lock "cinder-quobyte-8593dceb-b8f6-4b1f-b484-d8f00f3fbfca" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:45:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8e9ff207-a166-4a3f-8ffd-146254700803 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "cinder-quobyte-8593dceb-b8f6-4b1f-b484-d8f00f3fbfca" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:45:03 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-8e9ff207-a166-4a3f-8ffd-146254700803 tempest-VolumesSnapshotListTestJSON-1843389576 None] Deleting offline snapshot 8593dceb-b8f6-4b1f-b484-d8f00f3fbfca of volume 5e48db9e-19d5-48b9-aa2b-8fc98585d36f {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:45:03 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-8e9ff207-a166-4a3f-8ffd-146254700803 tempest-VolumesSnapshotListTestJSON-1843389576 None] snapshot_file for this snap is: volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.8593dceb-b8f6-4b1f-b484-d8f00f3fbfca {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:45:03 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ac0be1-d933-47cd-93a7-d7e4934a6359]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:45:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8e9ff207-a166-4a3f-8ffd-146254700803 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.8593dceb-b8f6-4b1f-b484-d8f00f3fbfca {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:03 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.8593dceb-b8f6-4b1f-b484-d8f00f3fbfca Aug 27 03:45:03 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:03 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8e9ff207-a166-4a3f-8ffd-146254700803 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.8593dceb-b8f6-4b1f-b484-d8f00f3fbfca" returned: 0 in 0.524s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:03 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-8e9ff207-a166-4a3f-8ffd-146254700803 tempest-VolumesSnapshotListTestJSON-1843389576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:45:03 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a278be2-d04e-4828-9905-fce61c0ef362]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:45:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8e9ff207-a166-4a3f-8ffd-146254700803 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:04 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045 Aug 27 03:45:04 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:04 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8e9ff207-a166-4a3f-8ffd-146254700803 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045" returned: 0 in 0.605s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:04 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-8e9ff207-a166-4a3f-8ffd-146254700803 tempest-VolumesSnapshotListTestJSON-1843389576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:45:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8e9ff207-a166-4a3f-8ffd-146254700803 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.8593dceb-b8f6-4b1f-b484-d8f00f3fbfca {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-0e356720-4be8-41da-9d67-89d318c5eb3a req-4c43f8c2-8a03-4f73-a5f2-f93ecaea8ab1 tempest-ServerActionsTestOtherA-581085483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:45:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-0e356720-4be8-41da-9d67-89d318c5eb3a req-4c43f8c2-8a03-4f73-a5f2-f93ecaea8ab1 tempest-ServerActionsTestOtherA-581085483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:45:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-0e356720-4be8-41da-9d67-89d318c5eb3a req-4c43f8c2-8a03-4f73-a5f2-f93ecaea8ab1 tempest-ServerActionsTestOtherA-581085483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:45:04 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.8593dceb-b8f6-4b1f-b484-d8f00f3fbfca Aug 27 03:45:04 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-0e356720-4be8-41da-9d67-89d318c5eb3a req-4c43f8c2-8a03-4f73-a5f2-f93ecaea8ab1 tempest-ServerActionsTestOtherA-581085483 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac', 'name': 'volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d6aea80-6811-4aeb-9262-438ac41ee5d6', 'enforce_multipath': True} {{(pid=94328) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 27 03:45:04 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-0e356720-4be8-41da-9d67-89d318c5eb3a req-4c43f8c2-8a03-4f73-a5f2-f93ecaea8ab1 tempest-ServerActionsTestOtherA-581085483 None] attachment_update completed successfully. Aug 27 03:45:05 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8e9ff207-a166-4a3f-8ffd-146254700803 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.8593dceb-b8f6-4b1f-b484-d8f00f3fbfca" returned: 0 in 0.714s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8e9ff207-a166-4a3f-8ffd-146254700803 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.8593dceb-b8f6-4b1f-b484-d8f00f3fbfca {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:05 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.8593dceb-b8f6-4b1f-b484-d8f00f3fbfca Aug 27 03:45:05 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:05 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8e9ff207-a166-4a3f-8ffd-146254700803 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.8593dceb-b8f6-4b1f-b484-d8f00f3fbfca" returned: 0 in 0.337s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8e9ff207-a166-4a3f-8ffd-146254700803 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "cinder-quobyte-8593dceb-b8f6-4b1f-b484-d8f00f3fbfca" released by "_delete_snapshot" :: held 2.320s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:45:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8e9ff207-a166-4a3f-8ffd-146254700803 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "cinder-quobyte-5e48db9e-19d5-48b9-aa2b-8fc98585d36f" released by "delete_snapshot" :: held 2.353s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:45:05 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-8e9ff207-a166-4a3f-8ffd-146254700803 tempest-VolumesSnapshotListTestJSON-1843389576 None] Created reservations ['3c8b0c51-c3e6-4fd0-8f9d-3c3cb505b34b', '40027bdf-09b2-4c41-8dfd-03e879e54063', '1b7d2b2d-9ce2-4624-b99d-a3d17d613aad', 'd7f97c0b-00e1-4d33-8409-2b99ce3057e9'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:45:05 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-8e9ff207-a166-4a3f-8ffd-146254700803 tempest-VolumesSnapshotListTestJSON-1843389576 None] Delete snapshot completed successfully. Aug 27 03:45:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8e9ff207-a166-4a3f-8ffd-146254700803 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "cinder-8593dceb-b8f6-4b1f-b484-d8f00f3fbfca-delete_snapshot" released by "delete_snapshot" :: held 2.562s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:45:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-22944609-c9ef-493d-ac8f-4be5c9ee6be0 tempest-VolumesSnapshotListTestJSON-1843389576 None] Acquiring lock "cinder-6f7d2b87-8dfa-497e-ae07-b84c8f15a045-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:45:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-22944609-c9ef-493d-ac8f-4be5c9ee6be0 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "cinder-6f7d2b87-8dfa-497e-ae07-b84c8f15a045-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:45:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-22944609-c9ef-493d-ac8f-4be5c9ee6be0 tempest-VolumesSnapshotListTestJSON-1843389576 None] Acquiring lock "cinder-quobyte-5e48db9e-19d5-48b9-aa2b-8fc98585d36f" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:45:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-22944609-c9ef-493d-ac8f-4be5c9ee6be0 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "cinder-quobyte-5e48db9e-19d5-48b9-aa2b-8fc98585d36f" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:45:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-22944609-c9ef-493d-ac8f-4be5c9ee6be0 tempest-VolumesSnapshotListTestJSON-1843389576 None] Acquiring lock "cinder-quobyte-6f7d2b87-8dfa-497e-ae07-b84c8f15a045" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:45:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-22944609-c9ef-493d-ac8f-4be5c9ee6be0 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "cinder-quobyte-6f7d2b87-8dfa-497e-ae07-b84c8f15a045" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:45:06 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-22944609-c9ef-493d-ac8f-4be5c9ee6be0 tempest-VolumesSnapshotListTestJSON-1843389576 None] Deleting offline snapshot 6f7d2b87-8dfa-497e-ae07-b84c8f15a045 of volume 5e48db9e-19d5-48b9-aa2b-8fc98585d36f {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:45:06 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-22944609-c9ef-493d-ac8f-4be5c9ee6be0 tempest-VolumesSnapshotListTestJSON-1843389576 None] snapshot_file for this snap is: volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:45:06 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[beeb21f6-9556-464f-85dc-8444233bd3c1]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:45:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-22944609-c9ef-493d-ac8f-4be5c9ee6be0 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:06 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045 Aug 27 03:45:06 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:07 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-9d44cd1a-c2ea-41b9-a7d0-4fdaf12e0765 req-c86eb9c7-7f37-4b72-a50c-244ceb7207d5 tempest-AttachVolumeNegativeTest-1215284800 None] Terminate volume connection completed successfully. Aug 27 03:45:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-9d44cd1a-c2ea-41b9-a7d0-4fdaf12e0765 req-c86eb9c7-7f37-4b72-a50c-244ceb7207d5 tempest-AttachVolumeNegativeTest-1215284800 None] Deleting attachment eae5020a-6d2a-4f06-b8e3-1e65334ed30c. {{(pid=94328) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 27 03:45:07 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-22944609-c9ef-493d-ac8f-4be5c9ee6be0 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045" returned: 0 in 0.799s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-22944609-c9ef-493d-ac8f-4be5c9ee6be0 tempest-VolumesSnapshotListTestJSON-1843389576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:45:07 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed6aed2-07b7-4351-8056-55d1102fe6fc]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:45:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-22944609-c9ef-493d-ac8f-4be5c9ee6be0 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:07 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b Aug 27 03:45:07 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:07 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-458280e1-b517-453c-9c2f-a922bb335c18 tempest-GroupSnapshotsTest-405720423 None] Group tempest-GroupSnapshotsTest-Group-177808642: creating Aug 27 03:45:07 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-458280e1-b517-453c-9c2f-a922bb335c18 tempest-GroupSnapshotsTest-405720423 None] Group tempest-GroupSnapshotsTest-Group-177808642: created successfully Aug 27 03:45:07 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-458280e1-b517-453c-9c2f-a922bb335c18 tempest-GroupSnapshotsTest-405720423 None] Create group completed successfully. Aug 27 03:45:07 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-22944609-c9ef-493d-ac8f-4be5c9ee6be0 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b" returned: 0 in 0.494s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-22944609-c9ef-493d-ac8f-4be5c9ee6be0 tempest-VolumesSnapshotListTestJSON-1843389576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:45:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-22944609-c9ef-493d-ac8f-4be5c9ee6be0 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:08 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045 Aug 27 03:45:08 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:08 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-22944609-c9ef-493d-ac8f-4be5c9ee6be0 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045" returned: 0 in 0.878s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-22944609-c9ef-493d-ac8f-4be5c9ee6be0 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:08 devstack sudo[103121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045 Aug 27 03:45:08 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:09 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-22944609-c9ef-493d-ac8f-4be5c9ee6be0 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.6f7d2b87-8dfa-497e-ae07-b84c8f15a045" returned: 0 in 0.635s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-22944609-c9ef-493d-ac8f-4be5c9ee6be0 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "cinder-quobyte-6f7d2b87-8dfa-497e-ae07-b84c8f15a045" released by "_delete_snapshot" :: held 3.018s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:45:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-22944609-c9ef-493d-ac8f-4be5c9ee6be0 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "cinder-quobyte-5e48db9e-19d5-48b9-aa2b-8fc98585d36f" released by "delete_snapshot" :: held 3.069s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:45:09 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-22944609-c9ef-493d-ac8f-4be5c9ee6be0 tempest-VolumesSnapshotListTestJSON-1843389576 None] Created reservations ['da6a1c09-34ae-48a6-9f89-b3ba9bc44ba6', '7f5f0d31-24ee-49d0-97ea-71c2732adf81', '2e70ae31-e132-4b0c-ad75-be595f96c916', '907a8b04-f9f4-459b-ba50-b3588b4a3c1b'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:45:09 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-22944609-c9ef-493d-ac8f-4be5c9ee6be0 tempest-VolumesSnapshotListTestJSON-1843389576 None] Delete snapshot completed successfully. Aug 27 03:45:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-22944609-c9ef-493d-ac8f-4be5c9ee6be0 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "cinder-6f7d2b87-8dfa-497e-ae07-b84c8f15a045-delete_snapshot" released by "delete_snapshot" :: held 3.390s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:45:09 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:45:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Flow 'volume_create_manager' (cec390a5-8ad7-4fa6-90bc-ac75c521f536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:45:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86db9059-5628-4964-904a-da3355d1d2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:45:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86db9059-5628-4964-904a-da3355d1d2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1947958562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=99c086e8-80b8-430c-9e9f-b0d770fa5797,host='devstack@QuobyteHD#QuobyteHD',id=63e7863f-5969-4614-aa50-bfa62d92e35e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46a45aa55e54bd9a6460fc4524da7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:45:10Z,use_quota=True,user_id='5b63b36dc22d432898682f8cb9686656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ad0deac-139e-4e77-91ed-0a513ae136b4),volume_type_id=1ad0deac-139e-4e77-91ed-0a513ae136b4)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:45:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (284793bc-2516-430e-aa61-6d34b744bcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:45:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (284793bc-2516-430e-aa61-6d34b744bcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:45:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67753dde-99f7-4213-a1a6-f0502581905b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67753dde-99f7-4213-a1a6-f0502581905b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63e7863f-5969-4614-aa50-bfa62d92e35e', 'volume_name': 'volume-63e7863f-5969-4614-aa50-bfa62d92e35e', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ae4529-aa9b-4f32-b08c-775e2c7f9ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ae4529-aa9b-4f32-b08c-775e2c7f9ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399e91dd-73cb-4d40-b9d5-11ca9ccbbb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:45:10 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Volume 63e7863f-5969-4614-aa50-bfa62d92e35e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63e7863f-5969-4614-aa50-bfa62d92e35e', 'volume_size': 1} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=99c086e8-80b8-430c-9e9f-b0d770fa5797,created_at=2026-08-27T01:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1947958562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=99c086e8-80b8-430c-9e9f-b0d770fa5797,host='devstack@QuobyteHD#QuobyteHD',id=63e7863f-5969-4614-aa50-bfa62d92e35e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46a45aa55e54bd9a6460fc4524da7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:45:10Z,use_quota=True,user_id='5b63b36dc22d432898682f8cb9686656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ad0deac-139e-4e77-91ed-0a513ae136b4),volume_type_id=1ad0deac-139e-4e77-91ed-0a513ae136b4)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Creating volume 63e7863f-5969-4614-aa50-bfa62d92e35e {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:45:10 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-793843ab-ca21-4fd6-a6a8-821d86a20aa9 tempest-VolumesSnapshotListTestJSON-1843389576 None] Acquiring lock "cinder-bde7defd-b0c0-4f86-9e9b-d588a1e4902b-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:45:10 devstack sudo[103156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e 1073741824 Aug 27 03:45:10 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-793843ab-ca21-4fd6-a6a8-821d86a20aa9 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "cinder-bde7defd-b0c0-4f86-9e9b-d588a1e4902b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-793843ab-ca21-4fd6-a6a8-821d86a20aa9 tempest-VolumesSnapshotListTestJSON-1843389576 None] Acquiring lock "cinder-quobyte-5e48db9e-19d5-48b9-aa2b-8fc98585d36f" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-793843ab-ca21-4fd6-a6a8-821d86a20aa9 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "cinder-quobyte-5e48db9e-19d5-48b9-aa2b-8fc98585d36f" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-793843ab-ca21-4fd6-a6a8-821d86a20aa9 tempest-VolumesSnapshotListTestJSON-1843389576 None] Acquiring lock "cinder-quobyte-bde7defd-b0c0-4f86-9e9b-d588a1e4902b" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-793843ab-ca21-4fd6-a6a8-821d86a20aa9 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "cinder-quobyte-bde7defd-b0c0-4f86-9e9b-d588a1e4902b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-793843ab-ca21-4fd6-a6a8-821d86a20aa9 tempest-VolumesSnapshotListTestJSON-1843389576 None] Deleting offline snapshot bde7defd-b0c0-4f86-9e9b-d588a1e4902b of volume 5e48db9e-19d5-48b9-aa2b-8fc98585d36f {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-793843ab-ca21-4fd6-a6a8-821d86a20aa9 tempest-VolumesSnapshotListTestJSON-1843389576 None] snapshot_file for this snap is: volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2260f87-5916-47d2-a2f0-e9847d7a2728]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-793843ab-ca21-4fd6-a6a8-821d86a20aa9 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:10 devstack sudo[103161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b Aug 27 03:45:10 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:10 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-793843ab-ca21-4fd6-a6a8-821d86a20aa9 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b" returned: 0 in 0.510s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-793843ab-ca21-4fd6-a6a8-821d86a20aa9 tempest-VolumesSnapshotListTestJSON-1843389576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:45:10 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[7342b3e6-77bf-4290-ae42-f25377e58eb6]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-793843ab-ca21-4fd6-a6a8-821d86a20aa9 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e 1073741824" returned: 0 in 0.790s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:10 devstack sudo[103187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e Aug 27 03:45:10 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:10 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f Aug 27 03:45:10 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:11 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e" returned: 0 in 0.458s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:45:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:45:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399e91dd-73cb-4d40-b9d5-11ca9ccbbb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63e7863f-5969-4614-aa50-bfa62d92e35e', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:45:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa281def-f50a-4ed4-8981-4f7d26b836d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:45:11 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:11 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Volume volume-63e7863f-5969-4614-aa50-bfa62d92e35e (63e7863f-5969-4614-aa50-bfa62d92e35e): created successfully Aug 27 03:45:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa281def-f50a-4ed4-8981-4f7d26b836d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:45:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Flow 'volume_create_manager' (cec390a5-8ad7-4fa6-90bc-ac75c521f536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:45:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-793843ab-ca21-4fd6-a6a8-821d86a20aa9 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f" returned: 0 in 0.612s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-793843ab-ca21-4fd6-a6a8-821d86a20aa9 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:11 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-2e8e2e3e-41cd-47d2-8016-3953c8fde371 tempest-GroupSnapshotsTest-405720423 None] Created volume successfully. Aug 27 03:45:11 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b Aug 27 03:45:11 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:11 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-793843ab-ca21-4fd6-a6a8-821d86a20aa9 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b" returned: 0 in 0.544s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-793843ab-ca21-4fd6-a6a8-821d86a20aa9 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:12 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b Aug 27 03:45:12 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:12 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-793843ab-ca21-4fd6-a6a8-821d86a20aa9 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f.bde7defd-b0c0-4f86-9e9b-d588a1e4902b" returned: 0 in 0.502s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-793843ab-ca21-4fd6-a6a8-821d86a20aa9 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "cinder-quobyte-bde7defd-b0c0-4f86-9e9b-d588a1e4902b" released by "_delete_snapshot" :: held 2.379s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:45:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-793843ab-ca21-4fd6-a6a8-821d86a20aa9 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "cinder-quobyte-5e48db9e-19d5-48b9-aa2b-8fc98585d36f" released by "delete_snapshot" :: held 2.417s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:45:12 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-793843ab-ca21-4fd6-a6a8-821d86a20aa9 tempest-VolumesSnapshotListTestJSON-1843389576 None] Created reservations ['3c07c1fa-3e78-41ca-8b8c-3e21573f9b93', 'd95e2008-2528-400b-8390-311ee8bf1fa9', '83fa7c36-e6c6-48f2-a0d0-301b1cfe8f58', '36e3d078-5682-4617-bbc1-906686f2c3a4'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:45:12 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-793843ab-ca21-4fd6-a6a8-821d86a20aa9 tempest-VolumesSnapshotListTestJSON-1843389576 None] Delete snapshot completed successfully. Aug 27 03:45:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-793843ab-ca21-4fd6-a6a8-821d86a20aa9 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "cinder-bde7defd-b0c0-4f86-9e9b-d588a1e4902b-delete_snapshot" released by "delete_snapshot" :: held 2.834s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:45:13 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-67e230d5-6a80-4a48-85da-e3c3edd6aa91 tempest-GroupSnapshotsTest-405720423 None] GroupSnapshot 81aac376-3d5f-4cb3-93b2-5917b8a7eb1b: creating. Aug 27 03:45:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-67e230d5-6a80-4a48-85da-e3c3edd6aa91 tempest-GroupSnapshotsTest-405720423 None] Group snapshot 81aac376-3d5f-4cb3-93b2-5917b8a7eb1b: creating. {{(pid=94328) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 27 03:45:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-67e230d5-6a80-4a48-85da-e3c3edd6aa91 tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:45:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-67e230d5-6a80-4a48-85da-e3c3edd6aa91 tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:45:13 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-67e230d5-6a80-4a48-85da-e3c3edd6aa91 tempest-GroupSnapshotsTest-405720423 None] Creating offline snapshot 3aae995a-c45c-4cd3-8b7a-6af3347f1dca of volume 63e7863f-5969-4614-aa50-bfa62d92e35e {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:45:13 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88c30ea-a32c-42bf-9f8a-d180689f8569]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:45:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-67e230d5-6a80-4a48-85da-e3c3edd6aa91 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:13 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e Aug 27 03:45:13 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8fb2394c-3be4-44fb-9df9-e15348971d13 tempest-VolumesSnapshotListTestJSON-1843389576 None] Acquiring lock "cinder-5e48db9e-19d5-48b9-aa2b-8fc98585d36f-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:45:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8fb2394c-3be4-44fb-9df9-e15348971d13 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "cinder-5e48db9e-19d5-48b9-aa2b-8fc98585d36f-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:45:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8fb2394c-3be4-44fb-9df9-e15348971d13 tempest-VolumesSnapshotListTestJSON-1843389576 None] Acquiring lock "cinder-quobyte-5e48db9e-19d5-48b9-aa2b-8fc98585d36f" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:45:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8fb2394c-3be4-44fb-9df9-e15348971d13 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "cinder-quobyte-5e48db9e-19d5-48b9-aa2b-8fc98585d36f" acquired by "delete_volume" :: waited 0.066s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:45:14 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f5e50e-429c-4425-9a88-ae986b0d65e0]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:45:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8fb2394c-3be4-44fb-9df9-e15348971d13 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:14 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:14 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f Aug 27 03:45:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-67e230d5-6a80-4a48-85da-e3c3edd6aa91 tempest-GroupSnapshotsTest-405720423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e" returned: 0 in 1.036s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:14 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-67e230d5-6a80-4a48-85da-e3c3edd6aa91 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.3aae995a-c45c-4cd3-8b7a-6af3347f1dca 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:14 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.3aae995a-c45c-4cd3-8b7a-6af3347f1dca 1G Aug 27 03:45:14 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:14 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8fb2394c-3be4-44fb-9df9-e15348971d13 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f" returned: 0 in 0.571s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8fb2394c-3be4-44fb-9df9-e15348971d13 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:14 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f Aug 27 03:45:14 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:14 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager._thread_info {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:45:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread count: 28 {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 03:45:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread info: [<_MainThread(MainThread, started 134250325188736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 03:45:14 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-67e230d5-6a80-4a48-85da-e3c3edd6aa91 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.3aae995a-c45c-4cd3-8b7a-6af3347f1dca 1G" returned: 0 in 0.695s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-67e230d5-6a80-4a48-85da-e3c3edd6aa91 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63e7863f-5969-4614-aa50-bfa62d92e35e -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.3aae995a-c45c-4cd3-8b7a-6af3347f1dca {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:14 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63e7863f-5969-4614-aa50-bfa62d92e35e -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.3aae995a-c45c-4cd3-8b7a-6af3347f1dca Aug 27 03:45:14 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:15 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8fb2394c-3be4-44fb-9df9-e15348971d13 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e48db9e-19d5-48b9-aa2b-8fc98585d36f" returned: 0 in 0.642s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:15 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8fb2394c-3be4-44fb-9df9-e15348971d13 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "cinder-quobyte-5e48db9e-19d5-48b9-aa2b-8fc98585d36f" released by "delete_volume" :: held 1.329s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:45:15 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-8fb2394c-3be4-44fb-9df9-e15348971d13 tempest-VolumesSnapshotListTestJSON-1843389576 None] Created reservations ['93b22cc0-b801-4930-b570-00e728809b41', '42127dac-cbc4-45ad-a00f-48133b8e4b95', '6b25dfcd-d0fd-4bad-aa18-94e747792e2f', 'ec961755-5daf-41b0-b188-b207498e5739'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:45:15 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-67e230d5-6a80-4a48-85da-e3c3edd6aa91 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63e7863f-5969-4614-aa50-bfa62d92e35e -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.3aae995a-c45c-4cd3-8b7a-6af3347f1dca" returned: 0 in 0.591s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:15 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-67e230d5-6a80-4a48-85da-e3c3edd6aa91 tempest-GroupSnapshotsTest-405720423 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.3aae995a-c45c-4cd3-8b7a-6af3347f1dca is being set with open permissions: ugo+rw: NotImplementedError Aug 27 03:45:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-67e230d5-6a80-4a48-85da-e3c3edd6aa91 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.3aae995a-c45c-4cd3-8b7a-6af3347f1dca {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:15 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.3aae995a-c45c-4cd3-8b7a-6af3347f1dca Aug 27 03:45:15 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8fb2394c-3be4-44fb-9df9-e15348971d13 tempest-VolumesSnapshotListTestJSON-1843389576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:45:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8fb2394c-3be4-44fb-9df9-e15348971d13 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:45:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8fb2394c-3be4-44fb-9df9-e15348971d13 tempest-VolumesSnapshotListTestJSON-1843389576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:45:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8fb2394c-3be4-44fb-9df9-e15348971d13 tempest-VolumesSnapshotListTestJSON-1843389576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:45:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8fb2394c-3be4-44fb-9df9-e15348971d13 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:45:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8fb2394c-3be4-44fb-9df9-e15348971d13 tempest-VolumesSnapshotListTestJSON-1843389576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:15 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:45:15 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:15 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-67e230d5-6a80-4a48-85da-e3c3edd6aa91 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.3aae995a-c45c-4cd3-8b7a-6af3347f1dca" returned: 0 in 0.500s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-67e230d5-6a80-4a48-85da-e3c3edd6aa91 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:16 devstack sudo[103247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.info Aug 27 03:45:16 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:16 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8fb2394c-3be4-44fb-9df9-e15348971d13 tempest-VolumesSnapshotListTestJSON-1843389576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.486s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:16 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-8fb2394c-3be4-44fb-9df9-e15348971d13 tempest-VolumesSnapshotListTestJSON-1843389576 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:45:16 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-8fb2394c-3be4-44fb-9df9-e15348971d13 tempest-VolumesSnapshotListTestJSON-1843389576 None] Deleted volume successfully. Aug 27 03:45:16 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8fb2394c-3be4-44fb-9df9-e15348971d13 tempest-VolumesSnapshotListTestJSON-1843389576 None] Lock "cinder-5e48db9e-19d5-48b9-aa2b-8fc98585d36f-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:45:16 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-67e230d5-6a80-4a48-85da-e3c3edd6aa91 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.info" returned: 0 in 0.633s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:16 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-67e230d5-6a80-4a48-85da-e3c3edd6aa91 tempest-GroupSnapshotsTest-405720423 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.info is being set with open permissions: ugo+rw: NotImplementedError Aug 27 03:45:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-67e230d5-6a80-4a48-85da-e3c3edd6aa91 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:16 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.info Aug 27 03:45:16 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:17 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-67e230d5-6a80-4a48-85da-e3c3edd6aa91 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.info" returned: 0 in 0.470s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-67e230d5-6a80-4a48-85da-e3c3edd6aa91 tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.054s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:45:17 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-67e230d5-6a80-4a48-85da-e3c3edd6aa91 tempest-GroupSnapshotsTest-405720423 None] group_snapshot 81aac376-3d5f-4cb3-93b2-5917b8a7eb1b: created successfully Aug 27 03:45:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:45:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:45:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "cinder-quobyte-3aae995a-c45c-4cd3-8b7a-6af3347f1dca-259f8d38-405d-4527-afbe-1439cfcf3eab" by "_create_volume_from_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:45:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-3aae995a-c45c-4cd3-8b7a-6af3347f1dca-259f8d38-405d-4527-afbe-1439cfcf3eab" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:45:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Creating volume 259f8d38-405d-4527-afbe-1439cfcf3eab from snapshot 3aae995a-c45c-4cd3-8b7a-6af3347f1dca {{(pid=94328) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 27 03:45:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:45:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:45:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:45:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:45:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:45:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:45:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "cinder-quobyte-259f8d38-405d-4527-afbe-1439cfcf3eab" by "_copy_volume_from_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:45:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-259f8d38-405d-4527-afbe-1439cfcf3eab" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:45:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] snapshot: 3aae995a-c45c-4cd3-8b7a-6af3347f1dca, volume: 259f8d38-405d-4527-afbe-1439cfcf3eab, {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 27 03:45:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:45:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:45:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:45:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:45:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:45:19 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b3d890-06aa-41ea-835a-bfab6f78086e]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:45:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.3aae995a-c45c-4cd3-8b7a-6af3347f1dca {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:19 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.3aae995a-c45c-4cd3-8b7a-6af3347f1dca Aug 27 03:45:19 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:20 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.3aae995a-c45c-4cd3-8b7a-6af3347f1dca" returned: 0 in 0.789s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63e7863f-5969-4614-aa50-bfa62d92e35e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:45:20 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad14af3-c98a-44c9-8962-67e11ba42d59]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:45:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:20 devstack sudo[103261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e Aug 27 03:45:20 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:20 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e" returned: 0 in 0.688s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] will copy from snapshot at /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 27 03:45:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Creating direct copy from snapshot {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 27 03:45:21 devstack cinder-volume[94328]: DEBUG cinder.utils [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Path /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-259f8d38-405d-4527-afbe-1439cfcf3eab not found in is_blk_device check {{(pid=94328) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 27 03:45:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-259f8d38-405d-4527-afbe-1439cfcf3eab {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:21 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-259f8d38-405d-4527-afbe-1439cfcf3eab Aug 27 03:45:21 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:29 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:UPDATE=66,cinder:SELECT=86,cinder:INSERT=22,cinder:DELETE=8 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:45:29 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=68,cinder:INSERT=25,cinder:UPDATE=74,cinder:DELETE=3 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:45:30 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-259f8d38-405d-4527-afbe-1439cfcf3eab" returned: 0 in 9.471s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:30 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Image conversion details: src /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e, size 1024.00 MB, duration 9.47 sec, destination /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-259f8d38-405d-4527-afbe-1439cfcf3eab {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:45:30 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Converted 1024.00 MB image at 108.10 MB/s Aug 27 03:45:30 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-259f8d38-405d-4527-afbe-1439cfcf3eab is being set with open permissions: ugo+rw: NotImplementedError Aug 27 03:45:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-259f8d38-405d-4527-afbe-1439cfcf3eab {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:30 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-259f8d38-405d-4527-afbe-1439cfcf3eab Aug 27 03:45:30 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:30 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-259f8d38-405d-4527-afbe-1439cfcf3eab" returned: 0 in 0.365s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-259f8d38-405d-4527-afbe-1439cfcf3eab" released by "_copy_volume_from_snapshot" :: held 11.467s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:45:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-3aae995a-c45c-4cd3-8b7a-6af3347f1dca-259f8d38-405d-4527-afbe-1439cfcf3eab" released by "_create_volume_from_snapshot" :: held 11.582s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:45:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.604s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:45:31 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-ec4ac40a-b969-4505-ac45-49bb7324568b tempest-GroupSnapshotsTest-405720423 None] Create group from source-snapshot-81aac376-3d5f-4cb3-93b2-5917b8a7eb1b completed successfully. Aug 27 03:45:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1ec6796a-8212-4586-8737-aa6136349d09 tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "cinder-quobyte-259f8d38-405d-4527-afbe-1439cfcf3eab" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:45:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1ec6796a-8212-4586-8737-aa6136349d09 tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-259f8d38-405d-4527-afbe-1439cfcf3eab" acquired by "delete_volume" :: waited 0.028s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:45:31 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4e033b-891b-4ff6-861c-4c6717bd2593]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:45:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1ec6796a-8212-4586-8737-aa6136349d09 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-259f8d38-405d-4527-afbe-1439cfcf3eab {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:32 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-259f8d38-405d-4527-afbe-1439cfcf3eab Aug 27 03:45:32 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:32 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1ec6796a-8212-4586-8737-aa6136349d09 tempest-GroupSnapshotsTest-405720423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-259f8d38-405d-4527-afbe-1439cfcf3eab" returned: 0 in 0.781s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1ec6796a-8212-4586-8737-aa6136349d09 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-259f8d38-405d-4527-afbe-1439cfcf3eab {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:32 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-259f8d38-405d-4527-afbe-1439cfcf3eab Aug 27 03:45:32 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:33 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1ec6796a-8212-4586-8737-aa6136349d09 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-259f8d38-405d-4527-afbe-1439cfcf3eab" returned: 0 in 0.609s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:33 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1ec6796a-8212-4586-8737-aa6136349d09 tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-259f8d38-405d-4527-afbe-1439cfcf3eab" released by "delete_volume" :: held 1.486s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:45:33 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-9aca3a08-7d33-448f-9f3d-e3b671b2f302 req-3224910a-f123-47cc-a86a-051c6587cd33 tempest-ServerActionsTestOtherA-581085483 None] Terminate volume connection completed successfully. Aug 27 03:45:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-9aca3a08-7d33-448f-9f3d-e3b671b2f302 req-3224910a-f123-47cc-a86a-051c6587cd33 tempest-ServerActionsTestOtherA-581085483 None] Deleting attachment 0d6aea80-6811-4aeb-9262-438ac41ee5d6. {{(pid=94328) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 27 03:45:33 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-1ec6796a-8212-4586-8737-aa6136349d09 tempest-GroupSnapshotsTest-405720423 None] Created reservations ['c3f6df4d-f1dc-45c1-85ea-c0f79e36c51a'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:45:33 devstack cinder-volume[94328]: WARNING cinder.quota [None req-1ec6796a-8212-4586-8737-aa6136349d09 tempest-GroupSnapshotsTest-405720423 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-238673383 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-238673383, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:45:33 devstack cinder-volume[94328]: WARNING cinder.quota [None req-1ec6796a-8212-4586-8737-aa6136349d09 tempest-GroupSnapshotsTest-405720423 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-238673383 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-238673383, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:45:33 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-1ec6796a-8212-4586-8737-aa6136349d09 tempest-GroupSnapshotsTest-405720423 None] Created reservations ['3741d189-6f5c-4ab3-9307-6fe62a322a89', 'ab921794-ce4d-4ed5-b0f3-c48218f22475', '18305d2d-6b62-48a5-a131-bd0b5fed8923', '01d79574-6eaa-44cb-a779-97eea9391941'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:45:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1ec6796a-8212-4586-8737-aa6136349d09 tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:45:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1ec6796a-8212-4586-8737-aa6136349d09 tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:45:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1ec6796a-8212-4586-8737-aa6136349d09 tempest-GroupSnapshotsTest-405720423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:45:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1ec6796a-8212-4586-8737-aa6136349d09 tempest-GroupSnapshotsTest-405720423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:45:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1ec6796a-8212-4586-8737-aa6136349d09 tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:45:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1ec6796a-8212-4586-8737-aa6136349d09 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:34 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:45:34 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:34 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1ec6796a-8212-4586-8737-aa6136349d09 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.395s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:34 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-1ec6796a-8212-4586-8737-aa6136349d09 tempest-GroupSnapshotsTest-405720423 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:45:34 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-1ec6796a-8212-4586-8737-aa6136349d09 tempest-GroupSnapshotsTest-405720423 None] Delete group completed successfully. Aug 27 03:45:34 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-addbb286-dfd8-4eb8-80de-4f54e0bd4cf8 tempest-GroupSnapshotsTest-405720423 None] group_snapshot 81aac376-3d5f-4cb3-93b2-5917b8a7eb1b: deleting Aug 27 03:45:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-addbb286-dfd8-4eb8-80de-4f54e0bd4cf8 tempest-GroupSnapshotsTest-405720423 None] group_snapshot 81aac376-3d5f-4cb3-93b2-5917b8a7eb1b: deleting {{(pid=94328) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 27 03:45:35 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-addbb286-dfd8-4eb8-80de-4f54e0bd4cf8 tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "cinder-quobyte-63e7863f-5969-4614-aa50-bfa62d92e35e" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:45:35 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-addbb286-dfd8-4eb8-80de-4f54e0bd4cf8 tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-63e7863f-5969-4614-aa50-bfa62d92e35e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:45:35 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-addbb286-dfd8-4eb8-80de-4f54e0bd4cf8 tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "cinder-quobyte-3aae995a-c45c-4cd3-8b7a-6af3347f1dca" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:45:35 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-addbb286-dfd8-4eb8-80de-4f54e0bd4cf8 tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-3aae995a-c45c-4cd3-8b7a-6af3347f1dca" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:45:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-addbb286-dfd8-4eb8-80de-4f54e0bd4cf8 tempest-GroupSnapshotsTest-405720423 None] Deleting offline snapshot 3aae995a-c45c-4cd3-8b7a-6af3347f1dca of volume 63e7863f-5969-4614-aa50-bfa62d92e35e {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:45:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-addbb286-dfd8-4eb8-80de-4f54e0bd4cf8 tempest-GroupSnapshotsTest-405720423 None] snapshot_file for this snap is: volume-63e7863f-5969-4614-aa50-bfa62d92e35e.3aae995a-c45c-4cd3-8b7a-6af3347f1dca {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:45:35 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[6645f445-7a16-4708-99a5-ca01ea288e36]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:45:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-addbb286-dfd8-4eb8-80de-4f54e0bd4cf8 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.3aae995a-c45c-4cd3-8b7a-6af3347f1dca {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:35 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.3aae995a-c45c-4cd3-8b7a-6af3347f1dca Aug 27 03:45:35 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:35 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-addbb286-dfd8-4eb8-80de-4f54e0bd4cf8 tempest-GroupSnapshotsTest-405720423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.3aae995a-c45c-4cd3-8b7a-6af3347f1dca" returned: 0 in 0.740s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-addbb286-dfd8-4eb8-80de-4f54e0bd4cf8 tempest-GroupSnapshotsTest-405720423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63e7863f-5969-4614-aa50-bfa62d92e35e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:45:35 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57cac26-71a3-4f6f-be42-040797180258]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:45:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-addbb286-dfd8-4eb8-80de-4f54e0bd4cf8 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:36 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e Aug 27 03:45:36 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:36 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-addbb286-dfd8-4eb8-80de-4f54e0bd4cf8 tempest-GroupSnapshotsTest-405720423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e" returned: 0 in 0.806s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-addbb286-dfd8-4eb8-80de-4f54e0bd4cf8 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.3aae995a-c45c-4cd3-8b7a-6af3347f1dca {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:36 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.3aae995a-c45c-4cd3-8b7a-6af3347f1dca Aug 27 03:45:36 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:37 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-addbb286-dfd8-4eb8-80de-4f54e0bd4cf8 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.3aae995a-c45c-4cd3-8b7a-6af3347f1dca" returned: 0 in 0.763s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-addbb286-dfd8-4eb8-80de-4f54e0bd4cf8 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.3aae995a-c45c-4cd3-8b7a-6af3347f1dca {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:37 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.3aae995a-c45c-4cd3-8b7a-6af3347f1dca Aug 27 03:45:37 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:37 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-addbb286-dfd8-4eb8-80de-4f54e0bd4cf8 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e.3aae995a-c45c-4cd3-8b7a-6af3347f1dca" returned: 0 in 0.442s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:38 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-addbb286-dfd8-4eb8-80de-4f54e0bd4cf8 tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-3aae995a-c45c-4cd3-8b7a-6af3347f1dca" released by "_delete_snapshot" :: held 2.956s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:45:38 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-addbb286-dfd8-4eb8-80de-4f54e0bd4cf8 tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-63e7863f-5969-4614-aa50-bfa62d92e35e" released by "delete_snapshot" :: held 2.993s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:45:38 devstack cinder-volume[94328]: WARNING cinder.quota [None req-addbb286-dfd8-4eb8-80de-4f54e0bd4cf8 tempest-GroupSnapshotsTest-405720423 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-238673383 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-238673383, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:45:38 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-addbb286-dfd8-4eb8-80de-4f54e0bd4cf8 tempest-GroupSnapshotsTest-405720423 None] Created reservations ['0ba84759-6754-42fe-8404-9bb97751d924', '95e355de-f94f-4e44-96c6-db52ccd54d11', '75036ca7-0565-48f5-b202-891b0acf3392', '9a0ab4ff-1131-4e61-b678-f6ac982974d9'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:45:38 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-addbb286-dfd8-4eb8-80de-4f54e0bd4cf8 tempest-GroupSnapshotsTest-405720423 None] group_snapshot 81aac376-3d5f-4cb3-93b2-5917b8a7eb1b: deleted successfully Aug 27 03:45:39 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f9a30816-0945-4c2b-92ff-319055935426 tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "cinder-quobyte-63e7863f-5969-4614-aa50-bfa62d92e35e" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:45:39 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f9a30816-0945-4c2b-92ff-319055935426 tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-63e7863f-5969-4614-aa50-bfa62d92e35e" acquired by "delete_volume" :: waited 0.038s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:45:39 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea610e7-ba75-4f2f-adfb-0238d4826a16]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:45:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f9a30816-0945-4c2b-92ff-319055935426 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:39 devstack sudo[103492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e Aug 27 03:45:39 devstack sudo[103492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-9aca3a08-7d33-448f-9f3d-e3b671b2f302 req-65c6d527-743a-48d5-ab4d-b129c8a79142 tempest-ServerActionsTestOtherA-581085483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:45:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-9aca3a08-7d33-448f-9f3d-e3b671b2f302 req-65c6d527-743a-48d5-ab4d-b129c8a79142 tempest-ServerActionsTestOtherA-581085483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:45:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-9aca3a08-7d33-448f-9f3d-e3b671b2f302 req-65c6d527-743a-48d5-ab4d-b129c8a79142 tempest-ServerActionsTestOtherA-581085483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:45:40 devstack sudo[103492]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f9a30816-0945-4c2b-92ff-319055935426 tempest-GroupSnapshotsTest-405720423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e" returned: 0 in 0.790s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f9a30816-0945-4c2b-92ff-319055935426 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:40 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-9aca3a08-7d33-448f-9f3d-e3b671b2f302 req-65c6d527-743a-48d5-ab4d-b129c8a79142 tempest-ServerActionsTestOtherA-581085483 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac', 'name': 'volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08a5415b-de78-4958-8b4d-738899118ddb', 'enforce_multipath': True} {{(pid=94328) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 27 03:45:40 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e Aug 27 03:45:40 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:40 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-9aca3a08-7d33-448f-9f3d-e3b671b2f302 req-65c6d527-743a-48d5-ab4d-b129c8a79142 tempest-ServerActionsTestOtherA-581085483 None] attachment_update completed successfully. Aug 27 03:45:40 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f9a30816-0945-4c2b-92ff-319055935426 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-63e7863f-5969-4614-aa50-bfa62d92e35e" returned: 0 in 0.451s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:40 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f9a30816-0945-4c2b-92ff-319055935426 tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-63e7863f-5969-4614-aa50-bfa62d92e35e" released by "delete_volume" :: held 1.345s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:45:40 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-f9a30816-0945-4c2b-92ff-319055935426 tempest-GroupSnapshotsTest-405720423 None] Created reservations ['2a56d9f6-e1da-4887-8678-8d65c1bb59cd'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:45:40 devstack cinder-volume[94328]: WARNING cinder.db.api [None req-f9a30816-0945-4c2b-92ff-319055935426 tempest-GroupSnapshotsTest-405720423 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-238673383'] Aug 27 03:45:40 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-f9a30816-0945-4c2b-92ff-319055935426 tempest-GroupSnapshotsTest-405720423 None] Created reservations ['a09c6e90-7848-452b-a09b-dcf8b62a5d3b', 'db75042e-9373-4eb0-baac-69e2fd4336d5', '8c592dbb-e3d6-4452-8788-5819d1d830a4', 'c9dcb107-0ec9-4c15-bd49-14bb52d1d424'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:45:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f9a30816-0945-4c2b-92ff-319055935426 tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:45:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f9a30816-0945-4c2b-92ff-319055935426 tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:45:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f9a30816-0945-4c2b-92ff-319055935426 tempest-GroupSnapshotsTest-405720423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:45:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f9a30816-0945-4c2b-92ff-319055935426 tempest-GroupSnapshotsTest-405720423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:45:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f9a30816-0945-4c2b-92ff-319055935426 tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:45:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f9a30816-0945-4c2b-92ff-319055935426 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:41 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:45:41 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:41 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f9a30816-0945-4c2b-92ff-319055935426 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.441s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:41 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-f9a30816-0945-4c2b-92ff-319055935426 tempest-GroupSnapshotsTest-405720423 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:45:41 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f9a30816-0945-4c2b-92ff-319055935426 tempest-GroupSnapshotsTest-405720423 None] Delete group completed successfully. Aug 27 03:45:42 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e17b98c3-7b01-4716-82eb-f7fb3620e01a tempest-GroupSnapshotsTest-405720423 None] Group tempest-GroupSnapshotsTest-Group-702176484: creating Aug 27 03:45:42 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e17b98c3-7b01-4716-82eb-f7fb3620e01a tempest-GroupSnapshotsTest-405720423 None] Group tempest-GroupSnapshotsTest-Group-702176484: created successfully Aug 27 03:45:42 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e17b98c3-7b01-4716-82eb-f7fb3620e01a tempest-GroupSnapshotsTest-405720423 None] Create group completed successfully. Aug 27 03:45:45 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:45:45 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Flow 'volume_create_manager' (803414aa-cbaa-437d-9edc-7cc773523226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:45:45 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d4cc91-f3cf-4ef4-900c-34852d792ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:45:45 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d4cc91-f3cf-4ef4-900c-34852d792ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-853471345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7a9e8ea7-0bdd-4f6a-bc6b-cb169a27b38a,host='devstack@QuobyteHD#QuobyteHD',id=f4ed2da8-7d42-4ee3-b734-bc698b3939cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46a45aa55e54bd9a6460fc4524da7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:45:45Z,use_quota=True,user_id='5b63b36dc22d432898682f8cb9686656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7a279a7-bbcd-4662-9124-89f807659340),volume_type_id=a7a279a7-bbcd-4662-9124-89f807659340)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:45:45 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed2ce54-a37b-4705-a1bf-d4b97aead3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:45:45 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed2ce54-a37b-4705-a1bf-d4b97aead3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:45:45 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41bc4aae-0292-46fc-8c2f-52297659608d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:45:45 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41bc4aae-0292-46fc-8c2f-52297659608d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4ed2da8-7d42-4ee3-b734-bc698b3939cf', 'volume_name': 'volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:45:45 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc41bc6a-2319-4579-a3e6-146b9124d32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:45:45 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc41bc6a-2319-4579-a3e6-146b9124d32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:45:45 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0359ff6-d3ad-42a0-8ae6-9e6d10ee7416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:45:45 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Volume f4ed2da8-7d42-4ee3-b734-bc698b3939cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf', 'volume_size': 1} Aug 27 03:45:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:45:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:45:45 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7a9e8ea7-0bdd-4f6a-bc6b-cb169a27b38a,created_at=2026-08-27T01:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-853471345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7a9e8ea7-0bdd-4f6a-bc6b-cb169a27b38a,host='devstack@QuobyteHD#QuobyteHD',id=f4ed2da8-7d42-4ee3-b734-bc698b3939cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46a45aa55e54bd9a6460fc4524da7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:45:45Z,use_quota=True,user_id='5b63b36dc22d432898682f8cb9686656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7a279a7-bbcd-4662-9124-89f807659340),volume_type_id=a7a279a7-bbcd-4662-9124-89f807659340)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:45:45 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Creating volume f4ed2da8-7d42-4ee3-b734-bc698b3939cf {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:45:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:45:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:45:45 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:45:45 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:45:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:45:45 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:45:45 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:45:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:45 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf 1073741824 Aug 27 03:45:45 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:46 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf 1073741824" returned: 0 in 1.062s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:46 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf Aug 27 03:45:46 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:47 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf" returned: 0 in 0.489s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:47 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:45:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:45:47 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0359ff6-d3ad-42a0-8ae6-9e6d10ee7416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:45:47 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d1235e-5607-41eb-acde-c76bf913a53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:45:47 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Volume volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf (f4ed2da8-7d42-4ee3-b734-bc698b3939cf): created successfully Aug 27 03:45:47 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d1235e-5607-41eb-acde-c76bf913a53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:45:47 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Flow 'volume_create_manager' (803414aa-cbaa-437d-9edc-7cc773523226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:45:47 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-91aa5ae3-cce8-44a5-bbb6-cb49d824aa28 tempest-GroupSnapshotsTest-405720423 None] Created volume successfully. Aug 27 03:45:49 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:45:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Flow 'volume_create_manager' (9314f749-33b5-41b1-935c-1b19cd309ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:45:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa527693-2592-40d5-99b5-477a7c212048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:45:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa527693-2592-40d5-99b5-477a7c212048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1141176449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7a9e8ea7-0bdd-4f6a-bc6b-cb169a27b38a,host='devstack@QuobyteHD#QuobyteHD',id=fcf63fd3-a039-42d6-9942-820a2b4a8cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46a45aa55e54bd9a6460fc4524da7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:45:49Z,use_quota=True,user_id='5b63b36dc22d432898682f8cb9686656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7a279a7-bbcd-4662-9124-89f807659340),volume_type_id=a7a279a7-bbcd-4662-9124-89f807659340)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:45:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (898a14e2-3f09-451d-ba04-4ba7da56929b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:45:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (898a14e2-3f09-451d-ba04-4ba7da56929b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:45:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d500f68-f454-4d38-95d3-a47d6ac28e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:45:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d500f68-f454-4d38-95d3-a47d6ac28e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcf63fd3-a039-42d6-9942-820a2b4a8cf4', 'volume_name': 'volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:45:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe1e856-a9c3-4239-a259-ed37ac4d3762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:45:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe1e856-a9c3-4239-a259-ed37ac4d3762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:45:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5094f3b4-3e3c-427f-a425-62561d133e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:45:49 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Volume fcf63fd3-a039-42d6-9942-820a2b4a8cf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4', 'volume_size': 1} Aug 27 03:45:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:45:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:45:49 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7a9e8ea7-0bdd-4f6a-bc6b-cb169a27b38a,created_at=2026-08-27T01:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1141176449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7a9e8ea7-0bdd-4f6a-bc6b-cb169a27b38a,host='devstack@QuobyteHD#QuobyteHD',id=fcf63fd3-a039-42d6-9942-820a2b4a8cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46a45aa55e54bd9a6460fc4524da7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:45:49Z,use_quota=True,user_id='5b63b36dc22d432898682f8cb9686656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7a279a7-bbcd-4662-9124-89f807659340),volume_type_id=a7a279a7-bbcd-4662-9124-89f807659340)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:45:49 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Creating volume fcf63fd3-a039-42d6-9942-820a2b4a8cf4 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:45:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:45:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:45:49 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:45:49 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:45:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:45:49 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:45:49 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:45:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:49 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4 1073741824 Aug 27 03:45:49 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:50 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4 1073741824" returned: 0 in 0.568s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:50 devstack sudo[103983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4 Aug 27 03:45:50 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:50 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4" returned: 0 in 0.375s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:45:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:45:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5094f3b4-3e3c-427f-a425-62561d133e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:45:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b3884a-ef10-44d5-9818-57a9f214e47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:45:50 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Volume volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4 (fcf63fd3-a039-42d6-9942-820a2b4a8cf4): created successfully Aug 27 03:45:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b3884a-ef10-44d5-9818-57a9f214e47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:45:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Flow 'volume_create_manager' (9314f749-33b5-41b1-935c-1b19cd309ab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:45:51 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-5a8e6bc2-8372-42a3-8abb-10e778833a95 tempest-GroupSnapshotsTest-405720423 None] Created volume successfully. Aug 27 03:45:52 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-89e5e476-05a2-412e-a315-89c55ba1e65e tempest-GroupSnapshotsTest-405720423 None] Update group completed successfully. Aug 27 03:45:53 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-0f329a73-69ea-4ada-b193-562f9060a553 tempest-GroupSnapshotsTest-405720423 None] Update group completed successfully. Aug 27 03:45:54 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-177aea11-85d1-455a-aaa6-facc797e8b43 tempest-GroupSnapshotsTest-405720423 None] Update group completed successfully. Aug 27 03:45:56 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-959688d2-f23a-4ce7-8dd3-61a33d48b930 tempest-GroupSnapshotsTest-405720423 None] Update group completed successfully. Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Flow 'volume_create_manager' (93197295-d305-427c-b05f-1f551812bc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff18db1-5771-4558-be85-a3c9ee2485ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:45:58 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] GroupSnapshot 0dc1100c-a041-4fb7-9d0c-f422c969a812: creating. Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff18db1-5771-4558-be85-a3c9ee2485ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1139242812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d84b20-9ed3-4c35-a042-ef86b08b1ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f3fb4bd8d7465b82c18cfd8fece208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:45:58Z,use_quota=True,user_id='51dc585b1b3240f9884aae1d03e2e63b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b02a702-f0e1-42c5-9bf7-ac0fbb9b587d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b02a702-f0e1-42c5-9bf7-ac0fbb9b587d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (059e2ac2-e725-4077-89b6-18600b50af1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (059e2ac2-e725-4077-89b6-18600b50af1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57d84b20-9ed3-4c35-a042-ef86b08b1ef5', 'volume_name': 'volume-57d84b20-9ed3-4c35-a042-ef86b08b1ef5', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0002f10f-a494-4df1-8e6d-650332a93397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0002f10f-a494-4df1-8e6d-650332a93397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c95fbfb-dea1-4757-a1c1-c2aa9e97fda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:45:58 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Volume 57d84b20-9ed3-4c35-a042-ef86b08b1ef5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57d84b20-9ed3-4c35-a042-ef86b08b1ef5', 'volume_size': 1} Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1139242812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d84b20-9ed3-4c35-a042-ef86b08b1ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f3fb4bd8d7465b82c18cfd8fece208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:45:58Z,use_quota=True,user_id='51dc585b1b3240f9884aae1d03e2e63b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Creating volume 57d84b20-9ed3-4c35-a042-ef86b08b1ef5 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:45:58 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-57d84b20-9ed3-4c35-a042-ef86b08b1ef5 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:58 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-57d84b20-9ed3-4c35-a042-ef86b08b1ef5 1073741824 Aug 27 03:45:58 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] Group snapshot 0dc1100c-a041-4fb7-9d0c-f422c969a812: creating. {{(pid=94328) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:45:58 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-57d84b20-9ed3-4c35-a042-ef86b08b1ef5 1073741824" returned: 0 in 0.523s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-57d84b20-9ed3-4c35-a042-ef86b08b1ef5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:58 devstack sudo[103994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-57d84b20-9ed3-4c35-a042-ef86b08b1ef5 Aug 27 03:45:58 devstack sudo[103994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:59 devstack sudo[103994]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-57d84b20-9ed3-4c35-a042-ef86b08b1ef5" returned: 0 in 0.270s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:45:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:45:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.759s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:45:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c95fbfb-dea1-4757-a1c1-c2aa9e97fda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57d84b20-9ed3-4c35-a042-ef86b08b1ef5', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:45:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89698f80-ac0a-4e70-9085-b45efe3563cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:45:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] Creating offline snapshot 11554299-4ba0-492f-931f-10d61dff35ae of volume fcf63fd3-a039-42d6-9942-820a2b4a8cf4 {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:45:59 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Volume volume-57d84b20-9ed3-4c35-a042-ef86b08b1ef5 (57d84b20-9ed3-4c35-a042-ef86b08b1ef5): created successfully Aug 27 03:45:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89698f80-ac0a-4e70-9085-b45efe3563cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:45:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Flow 'volume_create_manager' (93197295-d305-427c-b05f-1f551812bc3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:45:59 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61642ed-e358-42cd-86b9-9c2deaef7d67]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:45:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:59 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-20d91cb5-0a41-44f6-9df7-9ae76c8a5dea tempest-AttachVolumeNegativeTest-1215284800 None] Created volume successfully. Aug 27 03:45:59 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4 Aug 27 03:45:59 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:45:59 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Aug 27 03:45:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4" returned: 0 in 0.435s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:45:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.11554299-4ba0-492f-931f-10d61dff35ae 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:45:59 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.11554299-4ba0-492f-931f-10d61dff35ae 1G Aug 27 03:45:59 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:00 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.11554299-4ba0-492f-931f-10d61dff35ae 1G" returned: 0 in 0.524s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.11554299-4ba0-492f-931f-10d61dff35ae {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:00 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.11554299-4ba0-492f-931f-10d61dff35ae Aug 27 03:46:00 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:00 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.11554299-4ba0-492f-931f-10d61dff35ae" returned: 0 in 0.623s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:00 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.11554299-4ba0-492f-931f-10d61dff35ae is being set with open permissions: ugo+rw: NotImplementedError Aug 27 03:46:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.11554299-4ba0-492f-931f-10d61dff35ae {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:00 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.11554299-4ba0-492f-931f-10d61dff35ae Aug 27 03:46:00 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:01 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.11554299-4ba0-492f-931f-10d61dff35ae" returned: 0 in 0.447s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:01 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.info Aug 27 03:46:01 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-e60e1c5d-bc59-447f-bf3d-f76895af99e7 req-b0713192-2a91-400e-b93d-217490721dc7 tempest-AttachVolumeNegativeTest-1215284800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:01 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.info" returned: 0 in 0.445s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:01 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.info is being set with open permissions: ugo+rw: NotImplementedError Aug 27 03:46:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:01 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.info Aug 27 03:46:01 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:02 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.info" returned: 0 in 0.361s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] Creating offline snapshot 8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a of volume f4ed2da8-7d42-4ee3-b734-bc698b3939cf {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[678d2ffc-256b-4019-baaf-dbed1dbdee67]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:02 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf Aug 27 03:46:02 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Flow 'volume_create_manager' (f17cf7cb-b551-412e-93b1-d17bdaa6ac4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23d6098d-6806-4595-8cd3-7006e97ed7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23d6098d-6806-4595-8cd3-7006e97ed7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1209387246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e97ff7a-2aee-467c-97ad-64a194934156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34401a236754ed18e443c3aa87a1b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:46:02Z,use_quota=True,user_id='0018b8b319914c1da9ac7333ce185319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96533746-d61c-48bc-afbb-f8e13caf33b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96533746-d61c-48bc-afbb-f8e13caf33b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b1e782-929b-4f78-b870-3ac82c34d81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b1e782-929b-4f78-b870-3ac82c34d81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e97ff7a-2aee-467c-97ad-64a194934156', 'volume_name': 'volume-6e97ff7a-2aee-467c-97ad-64a194934156', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd06ec73-0a0f-4ca5-8d6c-c23171f2bc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd06ec73-0a0f-4ca5-8d6c-c23171f2bc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bdd84e0-bf09-4d85-a841-2083a19aa923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:02 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Volume 6e97ff7a-2aee-467c-97ad-64a194934156: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e97ff7a-2aee-467c-97ad-64a194934156', 'volume_size': 1} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:02 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf" returned: 0 in 0.562s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:46:02 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a 1G Aug 27 03:46:02 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Flow 'volume_create_manager' (ecb08388-ec18-4533-afd2-56f0c9d1e03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2822fde2-ceb0-4ee7-8de1-d11b04ddd1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2822fde2-ceb0-4ee7-8de1-d11b04ddd1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-940023478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe66522b-0eff-44d0-88eb-30389eab0814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34401a236754ed18e443c3aa87a1b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:46:03Z,use_quota=True,user_id='0018b8b319914c1da9ac7333ce185319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdfd31cc-9a2a-4942-ae27-49d411b417d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdfd31cc-9a2a-4942-ae27-49d411b417d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (920b1282-9e03-472f-a2a2-2bebc4d2aace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (920b1282-9e03-472f-a2a2-2bebc4d2aace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe66522b-0eff-44d0-88eb-30389eab0814', 'volume_name': 'volume-fe66522b-0eff-44d0-88eb-30389eab0814', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27231750-9024-4389-b5f7-ecd7359cd815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27231750-9024-4389-b5f7-ecd7359cd815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9394a9ba-aab5-40d4-bf64-1d8bc016ed3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:02 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Volume fe66522b-0eff-44d0-88eb-30389eab0814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe66522b-0eff-44d0-88eb-30389eab0814', 'volume_size': 1} Aug 27 03:46:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:03 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a 1G" returned: 0 in 0.461s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:03 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a Aug 27 03:46:03 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:03 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a" returned: 0 in 0.330s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:03 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a is being set with open permissions: ugo+rw: NotImplementedError Aug 27 03:46:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:03 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a Aug 27 03:46:03 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:03 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a" returned: 0 in 0.303s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:03 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.info Aug 27 03:46:03 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:04 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.info" returned: 0 in 0.264s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:04 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.info is being set with open permissions: ugo+rw: NotImplementedError Aug 27 03:46:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:04 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.info Aug 27 03:46:04 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:04 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.info" returned: 0 in 0.257s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.284s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-e60e1c5d-bc59-447f-bf3d-f76895af99e7 req-b0713192-2a91-400e-b93d-217490721dc7 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.754s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-e60e1c5d-bc59-447f-bf3d-f76895af99e7 req-b0713192-2a91-400e-b93d-217490721dc7 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.960s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:04 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1209387246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e97ff7a-2aee-467c-97ad-64a194934156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34401a236754ed18e443c3aa87a1b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:46:02Z,use_quota=True,user_id='0018b8b319914c1da9ac7333ce185319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:46:04 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Creating volume 6e97ff7a-2aee-467c-97ad-64a194934156 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:46:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:04 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:46:04 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:46:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:04 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:46:04 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:46:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6e97ff7a-2aee-467c-97ad-64a194934156 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:04 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6e97ff7a-2aee-467c-97ad-64a194934156 1073741824 Aug 27 03:46:04 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-e60e1c5d-bc59-447f-bf3d-f76895af99e7 req-b0713192-2a91-400e-b93d-217490721dc7 tempest-AttachVolumeNegativeTest-1215284800 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac', 'name': 'volume-57d84b20-9ed3-4c35-a042-ef86b08b1ef5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37339f4f-b9ac-4dc0-a395-efc7f8ab3f38', 'enforce_multipath': True} {{(pid=94328) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 27 03:46:04 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-e60e1c5d-bc59-447f-bf3d-f76895af99e7 req-b0713192-2a91-400e-b93d-217490721dc7 tempest-AttachVolumeNegativeTest-1215284800 None] attachment_update completed successfully. Aug 27 03:46:04 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-a6ca0884-8453-4249-bf8f-54afb413ea53 tempest-GroupSnapshotsTest-405720423 None] group_snapshot 0dc1100c-a041-4fb7-9d0c-f422c969a812: created successfully Aug 27 03:46:04 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] group_snapshot 0dc1100c-a041-4fb7-9d0c-f422c969a812: deleting Aug 27 03:46:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] group_snapshot 0dc1100c-a041-4fb7-9d0c-f422c969a812: deleting {{(pid=94328) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 27 03:46:04 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "cinder-quobyte-fcf63fd3-a039-42d6-9942-820a2b4a8cf4" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:46:05 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6e97ff7a-2aee-467c-97ad-64a194934156 1073741824" returned: 0 in 0.622s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-fcf63fd3-a039-42d6-9942-820a2b4a8cf4" acquired by "delete_snapshot" :: waited 0.037s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "cinder-quobyte-11554299-4ba0-492f-931f-10d61dff35ae" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-11554299-4ba0-492f-931f-10d61dff35ae" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Deleting offline snapshot 11554299-4ba0-492f-931f-10d61dff35ae of volume fcf63fd3-a039-42d6-9942-820a2b4a8cf4 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] snapshot_file for this snap is: volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.11554299-4ba0-492f-931f-10d61dff35ae {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6e97ff7a-2aee-467c-97ad-64a194934156 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1204d4d-55fb-4d68-9f68-5b84645d26e2]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.11554299-4ba0-492f-931f-10d61dff35ae {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:05 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6e97ff7a-2aee-467c-97ad-64a194934156 Aug 27 03:46:05 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:05 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.11554299-4ba0-492f-931f-10d61dff35ae Aug 27 03:46:05 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:05 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6e97ff7a-2aee-467c-97ad-64a194934156" returned: 0 in 0.417s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.765s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-940023478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe66522b-0eff-44d0-88eb-30389eab0814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34401a236754ed18e443c3aa87a1b3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:46:03Z,use_quota=True,user_id='0018b8b319914c1da9ac7333ce185319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Creating volume fe66522b-0eff-44d0-88eb-30389eab0814 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:46:05 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fe66522b-0eff-44d0-88eb-30389eab0814 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:05 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fe66522b-0eff-44d0-88eb-30389eab0814 1073741824 Aug 27 03:46:05 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bdd84e0-bf09-4d85-a841-2083a19aa923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e97ff7a-2aee-467c-97ad-64a194934156', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c0542a-ee26-44a0-a003-7809e8e81d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:05 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Volume volume-6e97ff7a-2aee-467c-97ad-64a194934156 (6e97ff7a-2aee-467c-97ad-64a194934156): created successfully Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c0542a-ee26-44a0-a003-7809e8e81d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Flow 'volume_create_manager' (f17cf7cb-b551-412e-93b1-d17bdaa6ac4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:46:05 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-b4170604-e1ac-4120-adb5-56256709b613 tempest-TestServerVolumeAttachmentScenario-2837056 None] Created volume successfully. Aug 27 03:46:05 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.11554299-4ba0-492f-931f-10d61dff35ae" returned: 0 in 0.518s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[649c2610-63c7-44d1-8a0f-6e31ed5e369c]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:46:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:05 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4 Aug 27 03:46:05 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:06 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4" returned: 0 in 0.475s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.11554299-4ba0-492f-931f-10d61dff35ae {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:06 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fe66522b-0eff-44d0-88eb-30389eab0814 1073741824" returned: 0 in 0.640s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:06 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.11554299-4ba0-492f-931f-10d61dff35ae Aug 27 03:46:06 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fe66522b-0eff-44d0-88eb-30389eab0814 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:06 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fe66522b-0eff-44d0-88eb-30389eab0814 Aug 27 03:46:06 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:06 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fe66522b-0eff-44d0-88eb-30389eab0814" returned: 0 in 0.316s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:06 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:46:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9394a9ba-aab5-40d4-bf64-1d8bc016ed3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe66522b-0eff-44d0-88eb-30389eab0814', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96bb108b-90a6-4203-9879-62ea2db8ecca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:06 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:06 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Volume volume-fe66522b-0eff-44d0-88eb-30389eab0814 (fe66522b-0eff-44d0-88eb-30389eab0814): created successfully Aug 27 03:46:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96bb108b-90a6-4203-9879-62ea2db8ecca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Flow 'volume_create_manager' (ecb08388-ec18-4533-afd2-56f0c9d1e03b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:46:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.11554299-4ba0-492f-931f-10d61dff35ae" returned: 0 in 0.486s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.11554299-4ba0-492f-931f-10d61dff35ae {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:06 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-005c47c6-3291-41fe-9c0a-92e9ea129ced tempest-TestServerVolumeAttachmentScenario-2837056 None] Created volume successfully. Aug 27 03:46:06 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.11554299-4ba0-492f-931f-10d61dff35ae Aug 27 03:46:06 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:06 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4.11554299-4ba0-492f-931f-10d61dff35ae" returned: 0 in 0.290s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-11554299-4ba0-492f-931f-10d61dff35ae" released by "_delete_snapshot" :: held 1.949s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:46:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-fcf63fd3-a039-42d6-9942-820a2b4a8cf4" released by "delete_snapshot" :: held 1.978s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:46:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "cinder-quobyte-f4ed2da8-7d42-4ee3-b734-bc698b3939cf" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:46:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-f4ed2da8-7d42-4ee3-b734-bc698b3939cf" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:46:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "cinder-quobyte-8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:46:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:46:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Deleting offline snapshot 8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a of volume f4ed2da8-7d42-4ee3-b734-bc698b3939cf {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:46:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] snapshot_file for this snap is: volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:46:07 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[294d3316-5d59-407a-a261-3c9cc03677ef]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:46:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:07 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-89401e0f-ead0-40da-a33c-b000eaab6ddf req-d3cb5ba4-9ef9-4de2-8e44-a3d99548c2d1 tempest-AttachVolumeNegativeTest-1215284800 None] Terminate volume connection completed successfully. Aug 27 03:46:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-89401e0f-ead0-40da-a33c-b000eaab6ddf req-d3cb5ba4-9ef9-4de2-8e44-a3d99548c2d1 tempest-AttachVolumeNegativeTest-1215284800 None] Deleting attachment 37339f4f-b9ac-4dc0-a395-efc7f8ab3f38. {{(pid=94328) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 27 03:46:07 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a Aug 27 03:46:07 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:07 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a" returned: 0 in 0.427s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:46:07 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[c322e0eb-97a3-4b9c-8f35-2f6cf8b6e5d2]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:46:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:07 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf Aug 27 03:46:07 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:08 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf" returned: 0 in 0.735s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:08 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a Aug 27 03:46:08 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:09 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a" returned: 0 in 0.802s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:09 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a Aug 27 03:46:09 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:09 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf.8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a" returned: 0 in 0.307s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-8fe109cf-9ebf-4dd8-b6f3-e1787b3f993a" released by "_delete_snapshot" :: held 2.415s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:46:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-f4ed2da8-7d42-4ee3-b734-bc698b3939cf" released by "delete_snapshot" :: held 2.441s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:46:09 devstack cinder-volume[94328]: WARNING cinder.quota [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2125162354 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2125162354, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:46:09 devstack cinder-volume[94328]: WARNING cinder.quota [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2125162354 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2125162354, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:46:09 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Created reservations ['207e43a0-1a16-4f04-921a-ba857a6aa3bf', '8ad865b7-fef7-4c6f-8569-9b4bfbf054b4', '05b3c3bc-0862-471c-901e-619121f8efb1', '8a1527f0-33a8-4ca7-9eaa-46bcdf8a436c'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:46:09 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] Created reservations ['1501174d-02cb-4979-bbe8-bcd8efa6b7da', 'e39bf250-1a92-4084-b18b-4f849b332bcc', '3fde54f8-6ad6-4911-b477-5ed977a8332d', 'c22da9e7-0552-4602-a99c-e9ba49d4eb77'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:46:09 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-c38288ba-b4b1-4d4d-8f3e-802b99b57650 tempest-GroupSnapshotsTest-405720423 None] group_snapshot 0dc1100c-a041-4fb7-9d0c-f422c969a812: deleted successfully Aug 27 03:46:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "cinder-quobyte-f4ed2da8-7d42-4ee3-b734-bc698b3939cf" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:46:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-f4ed2da8-7d42-4ee3-b734-bc698b3939cf" acquired by "delete_volume" :: waited 0.026s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:46:11 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda689a2-144c-4cc1-b2d4-bed45454f647]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:46:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:11 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf Aug 27 03:46:11 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:11 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf" returned: 0 in 0.599s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:11 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf Aug 27 03:46:11 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:12 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4ed2da8-7d42-4ee3-b734-bc698b3939cf" returned: 0 in 0.310s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-f4ed2da8-7d42-4ee3-b734-bc698b3939cf" released by "delete_volume" :: held 1.004s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:46:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "cinder-quobyte-fcf63fd3-a039-42d6-9942-820a2b4a8cf4" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:46:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-fcf63fd3-a039-42d6-9942-820a2b4a8cf4" acquired by "delete_volume" :: waited 0.027s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:46:12 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[9465a40a-1f0f-4e29-ab3c-e5c276a0f4a3]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:46:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:12 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4 Aug 27 03:46:12 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:13 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4" returned: 0 in 0.966s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:13 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4 Aug 27 03:46:13 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:13 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fcf63fd3-a039-42d6-9942-820a2b4a8cf4" returned: 0 in 0.473s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-fcf63fd3-a039-42d6-9942-820a2b4a8cf4" released by "delete_volume" :: held 1.705s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:46:14 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] Created reservations ['46182db5-f35e-4fe2-8077-f480c5b27a4c'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:46:14 devstack cinder-volume[94328]: WARNING cinder.quota [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2125162354 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2125162354, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:46:14 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] Created reservations ['111995af-0456-4ad0-b23a-b174d49d720c', '303707bc-5b4e-4450-8a1f-c93b5e96adc6', 'c434c66d-caef-4c8d-9b62-e10eefc8eb50', 'cacde950-4063-4bc2-a7fb-60a75b92ba17'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:46:14 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] Created reservations ['c76046d1-29f9-49df-806d-609490954084', 'cc322523-977b-4b18-ad16-d9dcaffda3b6', '9ad03fde-9af1-461b-82c5-4c28ace8b7c5', '7cb5cc3a-4060-4c46-b7d6-93ef560f4450'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:46:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:46:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:46:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:14 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:46:14 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:14 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:46:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:46:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:46:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:14 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:46:14 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:15 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.691s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:46:15 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-871c3621-810d-4541-af75-77ea8168522e tempest-GroupSnapshotsTest-405720423 None] Delete group completed successfully. Aug 27 03:46:15 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.460s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:46:15 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager._thread_info {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:46:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread count: 28 {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 03:46:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread info: [<_MainThread(MainThread, started 134250325188736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 03:46:16 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-7d24ff6d-b50a-4d01-bcb6-847405ea9093 tempest-GroupSnapshotsTest-405720423 None] Group tempest-GroupSnapshotsTest-Group-33394972: creating Aug 27 03:46:16 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-7d24ff6d-b50a-4d01-bcb6-847405ea9093 tempest-GroupSnapshotsTest-405720423 None] Group tempest-GroupSnapshotsTest-Group-33394972: created successfully Aug 27 03:46:16 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-7d24ff6d-b50a-4d01-bcb6-847405ea9093 tempest-GroupSnapshotsTest-405720423 None] Create group completed successfully. Aug 27 03:46:18 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:46:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Flow 'volume_create_manager' (647bec1c-db79-4737-8b34-b2b571b28bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:46:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a4fd172-f89e-4b67-a9d8-2ee447f37b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a4fd172-f89e-4b67-a9d8-2ee447f37b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1321784319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0cdf1580-81a8-4f90-a1ec-2ae69879911f,host='devstack@QuobyteHD#QuobyteHD',id=42c7e2ae-7710-4c8e-8769-b6c911e8134b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46a45aa55e54bd9a6460fc4524da7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:46:19Z,use_quota=True,user_id='5b63b36dc22d432898682f8cb9686656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2c23bb-2f79-4b9a-ba67-0bae286a31d2),volume_type_id=1f2c23bb-2f79-4b9a-ba67-0bae286a31d2)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae20d862-99e8-48d7-b8ac-d2719119db11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae20d862-99e8-48d7-b8ac-d2719119db11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a10310f-6948-4842-8eba-bb006fa9afdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a10310f-6948-4842-8eba-bb006fa9afdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42c7e2ae-7710-4c8e-8769-b6c911e8134b', 'volume_name': 'volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a5c838b-faf4-417d-a327-f41d39f33037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a5c838b-faf4-417d-a327-f41d39f33037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901a72fc-726b-41c1-b568-05905008064b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:18 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Volume 42c7e2ae-7710-4c8e-8769-b6c911e8134b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b', 'volume_size': 1} Aug 27 03:46:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0cdf1580-81a8-4f90-a1ec-2ae69879911f,created_at=2026-08-27T01:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1321784319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0cdf1580-81a8-4f90-a1ec-2ae69879911f,host='devstack@QuobyteHD#QuobyteHD',id=42c7e2ae-7710-4c8e-8769-b6c911e8134b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46a45aa55e54bd9a6460fc4524da7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:46:19Z,use_quota=True,user_id='5b63b36dc22d432898682f8cb9686656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f2c23bb-2f79-4b9a-ba67-0bae286a31d2),volume_type_id=1f2c23bb-2f79-4b9a-ba67-0bae286a31d2)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:46:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Creating volume 42c7e2ae-7710-4c8e-8769-b6c911e8134b {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:46:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:46:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:46:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:46:18 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:46:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:18 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b 1073741824 Aug 27 03:46:18 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:19 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b 1073741824" returned: 0 in 0.659s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:19 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b Aug 27 03:46:19 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:20 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b" returned: 0 in 0.452s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:46:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901a72fc-726b-41c1-b568-05905008064b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbfc3a6c-2b0f-494c-a5eb-b990f8d6eb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:20 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Volume volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b (42c7e2ae-7710-4c8e-8769-b6c911e8134b): created successfully Aug 27 03:46:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbfc3a6c-2b0f-494c-a5eb-b990f8d6eb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Flow 'volume_create_manager' (647bec1c-db79-4737-8b34-b2b571b28bb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:46:20 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e7d126c1-da58-4e4c-b428-74484072995e tempest-GroupSnapshotsTest-405720423 None] Created volume successfully. Aug 27 03:46:20 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-9eec7e8d-dfeb-4027-9ed1-7100537993f0 req-500b513f-f180-43ab-a79e-6ad8c518c01a tempest-ServerActionsTestOtherA-581085483 None] Terminate volume connection completed successfully. Aug 27 03:46:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-9eec7e8d-dfeb-4027-9ed1-7100537993f0 req-500b513f-f180-43ab-a79e-6ad8c518c01a tempest-ServerActionsTestOtherA-581085483 None] Deleting attachment 08a5415b-de78-4958-8b4d-738899118ddb. {{(pid=94328) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 27 03:46:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-9eec7e8d-dfeb-4027-9ed1-7100537993f0 req-222746fe-69e7-4d88-b1a7-a6bf3c8c04b1 tempest-ServerActionsTestOtherA-581085483 None] Acquiring lock "cinder-81b7a9a0-3130-4ed4-a73e-71a1d3debe56-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:46:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-9eec7e8d-dfeb-4027-9ed1-7100537993f0 req-222746fe-69e7-4d88-b1a7-a6bf3c8c04b1 tempest-ServerActionsTestOtherA-581085483 None] Lock "cinder-81b7a9a0-3130-4ed4-a73e-71a1d3debe56-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:46:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-9eec7e8d-dfeb-4027-9ed1-7100537993f0 req-222746fe-69e7-4d88-b1a7-a6bf3c8c04b1 tempest-ServerActionsTestOtherA-581085483 None] Acquiring lock "cinder-quobyte-81b7a9a0-3130-4ed4-a73e-71a1d3debe56" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:46:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-9eec7e8d-dfeb-4027-9ed1-7100537993f0 req-222746fe-69e7-4d88-b1a7-a6bf3c8c04b1 tempest-ServerActionsTestOtherA-581085483 None] Lock "cinder-quobyte-81b7a9a0-3130-4ed4-a73e-71a1d3debe56" acquired by "delete_volume" :: waited 0.033s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:46:20 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a87d8b-dda4-4177-8437-5446c620cd75]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:46:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-9eec7e8d-dfeb-4027-9ed1-7100537993f0 req-222746fe-69e7-4d88-b1a7-a6bf3c8c04b1 tempest-ServerActionsTestOtherA-581085483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:21 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56 Aug 27 03:46:21 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:21 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-9eec7e8d-dfeb-4027-9ed1-7100537993f0 req-222746fe-69e7-4d88-b1a7-a6bf3c8c04b1 tempest-ServerActionsTestOtherA-581085483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56" returned: 0 in 0.695s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-9eec7e8d-dfeb-4027-9ed1-7100537993f0 req-222746fe-69e7-4d88-b1a7-a6bf3c8c04b1 tempest-ServerActionsTestOtherA-581085483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:21 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56 Aug 27 03:46:21 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8751c1d3-3d32-4f32-bf1b-ca171fde7c2e tempest-ServerActionsTestOtherA-581085483 None] Acquiring lock "cinder-30612b6f-c78d-4217-a7a3-84d9cb3e6d97-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8751c1d3-3d32-4f32-bf1b-ca171fde7c2e tempest-ServerActionsTestOtherA-581085483 None] Lock "cinder-30612b6f-c78d-4217-a7a3-84d9cb3e6d97-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8751c1d3-3d32-4f32-bf1b-ca171fde7c2e tempest-ServerActionsTestOtherA-581085483 None] Acquiring lock "cinder-quobyte-30612b6f-c78d-4217-a7a3-84d9cb3e6d97" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8751c1d3-3d32-4f32-bf1b-ca171fde7c2e tempest-ServerActionsTestOtherA-581085483 None] Lock "cinder-quobyte-30612b6f-c78d-4217-a7a3-84d9cb3e6d97" acquired by "delete_volume" :: waited 0.035s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:46:22 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-40b8cf5d-bc48-4804-831b-f4c34c20b5b7 tempest-GroupSnapshotsTest-405720423 None] GroupSnapshot 3b052f47-dcd9-422e-afd8-25b87cc9521e: creating. Aug 27 03:46:22 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-9eec7e8d-dfeb-4027-9ed1-7100537993f0 req-222746fe-69e7-4d88-b1a7-a6bf3c8c04b1 tempest-ServerActionsTestOtherA-581085483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-81b7a9a0-3130-4ed4-a73e-71a1d3debe56" returned: 0 in 0.588s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce200e2-f0a5-40cd-8e3f-6d137e9ec442]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8751c1d3-3d32-4f32-bf1b-ca171fde7c2e tempest-ServerActionsTestOtherA-581085483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30612b6f-c78d-4217-a7a3-84d9cb3e6d97 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-9eec7e8d-dfeb-4027-9ed1-7100537993f0 req-222746fe-69e7-4d88-b1a7-a6bf3c8c04b1 tempest-ServerActionsTestOtherA-581085483 None] Lock "cinder-quobyte-81b7a9a0-3130-4ed4-a73e-71a1d3debe56" released by "delete_volume" :: held 1.400s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-40b8cf5d-bc48-4804-831b-f4c34c20b5b7 tempest-GroupSnapshotsTest-405720423 None] Group snapshot 3b052f47-dcd9-422e-afd8-25b87cc9521e: creating. {{(pid=94328) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-40b8cf5d-bc48-4804-831b-f4c34c20b5b7 tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-40b8cf5d-bc48-4804-831b-f4c34c20b5b7 tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-40b8cf5d-bc48-4804-831b-f4c34c20b5b7 tempest-GroupSnapshotsTest-405720423 None] Creating offline snapshot 247ac2b1-eded-465c-811f-3af23bc14f5d of volume 42c7e2ae-7710-4c8e-8769-b6c911e8134b {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f07162-bbb0-4d81-b419-fdca53d867bd]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-40b8cf5d-bc48-4804-831b-f4c34c20b5b7 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:22 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30612b6f-c78d-4217-a7a3-84d9cb3e6d97 Aug 27 03:46:22 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG cinder.quota [req-9eec7e8d-dfeb-4027-9ed1-7100537993f0 req-222746fe-69e7-4d88-b1a7-a6bf3c8c04b1 tempest-ServerActionsTestOtherA-581085483 None] Created reservations ['693ee052-52ac-4f89-9516-d73fa3366459', '1b72e461-78b3-4d8f-8b3c-553358fa0c89', 'b54568ed-67b7-46c6-93b3-95ef1c268aa3', '89f8a3bd-ab4b-472f-957d-ec9cb7c8cf07'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-9eec7e8d-dfeb-4027-9ed1-7100537993f0 req-222746fe-69e7-4d88-b1a7-a6bf3c8c04b1 tempest-ServerActionsTestOtherA-581085483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-9eec7e8d-dfeb-4027-9ed1-7100537993f0 req-222746fe-69e7-4d88-b1a7-a6bf3c8c04b1 tempest-ServerActionsTestOtherA-581085483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [req-9eec7e8d-dfeb-4027-9ed1-7100537993f0 req-222746fe-69e7-4d88-b1a7-a6bf3c8c04b1 tempest-ServerActionsTestOtherA-581085483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [req-9eec7e8d-dfeb-4027-9ed1-7100537993f0 req-222746fe-69e7-4d88-b1a7-a6bf3c8c04b1 tempest-ServerActionsTestOtherA-581085483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-9eec7e8d-dfeb-4027-9ed1-7100537993f0 req-222746fe-69e7-4d88-b1a7-a6bf3c8c04b1 tempest-ServerActionsTestOtherA-581085483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-9eec7e8d-dfeb-4027-9ed1-7100537993f0 req-222746fe-69e7-4d88-b1a7-a6bf3c8c04b1 tempest-ServerActionsTestOtherA-581085483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:22 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:46:22 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:22 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b Aug 27 03:46:22 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:22 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-9eec7e8d-dfeb-4027-9ed1-7100537993f0 req-222746fe-69e7-4d88-b1a7-a6bf3c8c04b1 tempest-ServerActionsTestOtherA-581085483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.351s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG cinder.manager [req-9eec7e8d-dfeb-4027-9ed1-7100537993f0 req-222746fe-69e7-4d88-b1a7-a6bf3c8c04b1 tempest-ServerActionsTestOtherA-581085483 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:46:22 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-9eec7e8d-dfeb-4027-9ed1-7100537993f0 req-222746fe-69e7-4d88-b1a7-a6bf3c8c04b1 tempest-ServerActionsTestOtherA-581085483 None] Deleted volume successfully. Aug 27 03:46:22 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8751c1d3-3d32-4f32-bf1b-ca171fde7c2e tempest-ServerActionsTestOtherA-581085483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30612b6f-c78d-4217-a7a3-84d9cb3e6d97" returned: 0 in 0.721s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8751c1d3-3d32-4f32-bf1b-ca171fde7c2e tempest-ServerActionsTestOtherA-581085483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30612b6f-c78d-4217-a7a3-84d9cb3e6d97 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:22 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-9eec7e8d-dfeb-4027-9ed1-7100537993f0 req-222746fe-69e7-4d88-b1a7-a6bf3c8c04b1 tempest-ServerActionsTestOtherA-581085483 None] Lock "cinder-81b7a9a0-3130-4ed4-a73e-71a1d3debe56-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:46:23 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30612b6f-c78d-4217-a7a3-84d9cb3e6d97 Aug 27 03:46:23 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:23 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-40b8cf5d-bc48-4804-831b-f4c34c20b5b7 tempest-GroupSnapshotsTest-405720423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b" returned: 0 in 0.680s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-40b8cf5d-bc48-4804-831b-f4c34c20b5b7 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.247ac2b1-eded-465c-811f-3af23bc14f5d 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:23 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.247ac2b1-eded-465c-811f-3af23bc14f5d 1G Aug 27 03:46:23 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:23 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8751c1d3-3d32-4f32-bf1b-ca171fde7c2e tempest-ServerActionsTestOtherA-581085483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30612b6f-c78d-4217-a7a3-84d9cb3e6d97" returned: 0 in 0.345s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:23 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8751c1d3-3d32-4f32-bf1b-ca171fde7c2e tempest-ServerActionsTestOtherA-581085483 None] Lock "cinder-quobyte-30612b6f-c78d-4217-a7a3-84d9cb3e6d97" released by "delete_volume" :: held 1.147s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:46:23 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-8751c1d3-3d32-4f32-bf1b-ca171fde7c2e tempest-ServerActionsTestOtherA-581085483 None] Created reservations ['09a5dc0a-b17a-4ba1-8f00-6d095a0df2a2', '473d9cca-6700-47e5-aeec-cde921c0ec94', 'ebec241f-eec2-488e-955b-1c52f10d00ac', '842a105d-eb02-407f-bb18-2a89e291ec80'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:46:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8751c1d3-3d32-4f32-bf1b-ca171fde7c2e tempest-ServerActionsTestOtherA-581085483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8751c1d3-3d32-4f32-bf1b-ca171fde7c2e tempest-ServerActionsTestOtherA-581085483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:23 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8751c1d3-3d32-4f32-bf1b-ca171fde7c2e tempest-ServerActionsTestOtherA-581085483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:46:23 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8751c1d3-3d32-4f32-bf1b-ca171fde7c2e tempest-ServerActionsTestOtherA-581085483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:46:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8751c1d3-3d32-4f32-bf1b-ca171fde7c2e tempest-ServerActionsTestOtherA-581085483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8751c1d3-3d32-4f32-bf1b-ca171fde7c2e tempest-ServerActionsTestOtherA-581085483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:23 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:46:23 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:23 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-40b8cf5d-bc48-4804-831b-f4c34c20b5b7 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.247ac2b1-eded-465c-811f-3af23bc14f5d 1G" returned: 0 in 0.695s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-40b8cf5d-bc48-4804-831b-f4c34c20b5b7 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.247ac2b1-eded-465c-811f-3af23bc14f5d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:23 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.247ac2b1-eded-465c-811f-3af23bc14f5d Aug 27 03:46:23 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:23 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8751c1d3-3d32-4f32-bf1b-ca171fde7c2e tempest-ServerActionsTestOtherA-581085483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.412s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:23 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-8751c1d3-3d32-4f32-bf1b-ca171fde7c2e tempest-ServerActionsTestOtherA-581085483 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:46:23 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-8751c1d3-3d32-4f32-bf1b-ca171fde7c2e tempest-ServerActionsTestOtherA-581085483 None] Deleted volume successfully. Aug 27 03:46:24 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8751c1d3-3d32-4f32-bf1b-ca171fde7c2e tempest-ServerActionsTestOtherA-581085483 None] Lock "cinder-30612b6f-c78d-4217-a7a3-84d9cb3e6d97-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:46:24 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-40b8cf5d-bc48-4804-831b-f4c34c20b5b7 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.247ac2b1-eded-465c-811f-3af23bc14f5d" returned: 0 in 0.396s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:24 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-40b8cf5d-bc48-4804-831b-f4c34c20b5b7 tempest-GroupSnapshotsTest-405720423 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.247ac2b1-eded-465c-811f-3af23bc14f5d is being set with open permissions: ugo+rw: NotImplementedError Aug 27 03:46:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-40b8cf5d-bc48-4804-831b-f4c34c20b5b7 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.247ac2b1-eded-465c-811f-3af23bc14f5d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:24 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.247ac2b1-eded-465c-811f-3af23bc14f5d Aug 27 03:46:24 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:24 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-40b8cf5d-bc48-4804-831b-f4c34c20b5b7 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.247ac2b1-eded-465c-811f-3af23bc14f5d" returned: 0 in 0.407s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-40b8cf5d-bc48-4804-831b-f4c34c20b5b7 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:24 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.info Aug 27 03:46:24 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:25 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-40b8cf5d-bc48-4804-831b-f4c34c20b5b7 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.info" returned: 0 in 0.466s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:25 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-40b8cf5d-bc48-4804-831b-f4c34c20b5b7 tempest-GroupSnapshotsTest-405720423 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.info is being set with open permissions: ugo+rw: NotImplementedError Aug 27 03:46:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-40b8cf5d-bc48-4804-831b-f4c34c20b5b7 tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:25 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.info Aug 27 03:46:25 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:25 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-40b8cf5d-bc48-4804-831b-f4c34c20b5b7 tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.info" returned: 0 in 0.577s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-40b8cf5d-bc48-4804-831b-f4c34c20b5b7 tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.412s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:25 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-40b8cf5d-bc48-4804-831b-f4c34c20b5b7 tempest-GroupSnapshotsTest-405720423 None] group_snapshot 3b052f47-dcd9-422e-afd8-25b87cc9521e: created successfully Aug 27 03:46:27 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-9bb9ceaf-adf4-4727-a629-d03d7b09634b tempest-GroupSnapshotsTest-405720423 None] group_snapshot 3b052f47-dcd9-422e-afd8-25b87cc9521e: deleting Aug 27 03:46:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-9bb9ceaf-adf4-4727-a629-d03d7b09634b tempest-GroupSnapshotsTest-405720423 None] group_snapshot 3b052f47-dcd9-422e-afd8-25b87cc9521e: deleting {{(pid=94328) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 27 03:46:27 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9bb9ceaf-adf4-4727-a629-d03d7b09634b tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "cinder-quobyte-42c7e2ae-7710-4c8e-8769-b6c911e8134b" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:46:27 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9bb9ceaf-adf4-4727-a629-d03d7b09634b tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-42c7e2ae-7710-4c8e-8769-b6c911e8134b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:46:27 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9bb9ceaf-adf4-4727-a629-d03d7b09634b tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "cinder-quobyte-247ac2b1-eded-465c-811f-3af23bc14f5d" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:46:27 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9bb9ceaf-adf4-4727-a629-d03d7b09634b tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-247ac2b1-eded-465c-811f-3af23bc14f5d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:46:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-9bb9ceaf-adf4-4727-a629-d03d7b09634b tempest-GroupSnapshotsTest-405720423 None] Deleting offline snapshot 247ac2b1-eded-465c-811f-3af23bc14f5d of volume 42c7e2ae-7710-4c8e-8769-b6c911e8134b {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:46:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-9bb9ceaf-adf4-4727-a629-d03d7b09634b tempest-GroupSnapshotsTest-405720423 None] snapshot_file for this snap is: volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.247ac2b1-eded-465c-811f-3af23bc14f5d {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:46:27 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed4a9fc-9167-45a8-bb8e-3e2ccecf8849]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:46:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9bb9ceaf-adf4-4727-a629-d03d7b09634b tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.247ac2b1-eded-465c-811f-3af23bc14f5d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:27 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.247ac2b1-eded-465c-811f-3af23bc14f5d Aug 27 03:46:27 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:28 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9bb9ceaf-adf4-4727-a629-d03d7b09634b tempest-GroupSnapshotsTest-405720423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.247ac2b1-eded-465c-811f-3af23bc14f5d" returned: 0 in 0.708s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:28 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-9bb9ceaf-adf4-4727-a629-d03d7b09634b tempest-GroupSnapshotsTest-405720423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:46:28 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ed4fb1-f79e-4998-b0f1-a2bf27f7e918]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:46:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9bb9ceaf-adf4-4727-a629-d03d7b09634b tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:28 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b Aug 27 03:46:28 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:28 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9bb9ceaf-adf4-4727-a629-d03d7b09634b tempest-GroupSnapshotsTest-405720423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b" returned: 0 in 0.577s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9bb9ceaf-adf4-4727-a629-d03d7b09634b tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.247ac2b1-eded-465c-811f-3af23bc14f5d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:28 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.247ac2b1-eded-465c-811f-3af23bc14f5d Aug 27 03:46:28 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:29 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9bb9ceaf-adf4-4727-a629-d03d7b09634b tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.247ac2b1-eded-465c-811f-3af23bc14f5d" returned: 0 in 0.622s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9bb9ceaf-adf4-4727-a629-d03d7b09634b tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.247ac2b1-eded-465c-811f-3af23bc14f5d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:29 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.247ac2b1-eded-465c-811f-3af23bc14f5d Aug 27 03:46:29 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:29 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9bb9ceaf-adf4-4727-a629-d03d7b09634b tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b.247ac2b1-eded-465c-811f-3af23bc14f5d" returned: 0 in 0.369s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9bb9ceaf-adf4-4727-a629-d03d7b09634b tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-247ac2b1-eded-465c-811f-3af23bc14f5d" released by "_delete_snapshot" :: held 2.421s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:46:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9bb9ceaf-adf4-4727-a629-d03d7b09634b tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-42c7e2ae-7710-4c8e-8769-b6c911e8134b" released by "delete_snapshot" :: held 2.458s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:46:29 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:UPDATE=113,cinder:SELECT=117,cinder:INSERT=22,cinder:DELETE=5 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:46:29 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=117,cinder:INSERT=27,cinder:UPDATE=107,cinder:DELETE=3 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:46:29 devstack cinder-volume[94328]: WARNING cinder.quota [None req-9bb9ceaf-adf4-4727-a629-d03d7b09634b tempest-GroupSnapshotsTest-405720423 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-34924950 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-34924950, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:46:29 devstack cinder-volume[94328]: WARNING cinder.quota [None req-9bb9ceaf-adf4-4727-a629-d03d7b09634b tempest-GroupSnapshotsTest-405720423 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-34924950 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-34924950, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:46:29 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-9bb9ceaf-adf4-4727-a629-d03d7b09634b tempest-GroupSnapshotsTest-405720423 None] Created reservations ['8460a71f-10c6-49cd-8e1e-f9b3c6c01001', '7e470a02-d3fb-4d56-9697-cc958c8dd6fa', '223f364f-b7a0-4d2e-b32f-93f528a4a227', '08159dc4-45ea-48e1-8c1f-f14fa791d265'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:46:29 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-9bb9ceaf-adf4-4727-a629-d03d7b09634b tempest-GroupSnapshotsTest-405720423 None] group_snapshot 3b052f47-dcd9-422e-afd8-25b87cc9521e: deleted successfully Aug 27 03:46:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-028d7659-e8c9-41b5-87a8-21ddf1e37dad tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "cinder-quobyte-42c7e2ae-7710-4c8e-8769-b6c911e8134b" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:46:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-028d7659-e8c9-41b5-87a8-21ddf1e37dad tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-42c7e2ae-7710-4c8e-8769-b6c911e8134b" acquired by "delete_volume" :: waited 0.030s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:46:31 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[2027e190-072d-412d-8eb6-e04ac18e03b5]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:46:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-028d7659-e8c9-41b5-87a8-21ddf1e37dad tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:31 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b Aug 27 03:46:31 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:32 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-028d7659-e8c9-41b5-87a8-21ddf1e37dad tempest-GroupSnapshotsTest-405720423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b" returned: 0 in 0.451s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-028d7659-e8c9-41b5-87a8-21ddf1e37dad tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:32 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b Aug 27 03:46:32 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:32 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-028d7659-e8c9-41b5-87a8-21ddf1e37dad tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42c7e2ae-7710-4c8e-8769-b6c911e8134b" returned: 0 in 0.274s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-028d7659-e8c9-41b5-87a8-21ddf1e37dad tempest-GroupSnapshotsTest-405720423 None] Lock "cinder-quobyte-42c7e2ae-7710-4c8e-8769-b6c911e8134b" released by "delete_volume" :: held 0.833s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:46:32 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-028d7659-e8c9-41b5-87a8-21ddf1e37dad tempest-GroupSnapshotsTest-405720423 None] Created reservations ['eab7189a-77ce-4591-8462-bff8c52bbcca'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:46:32 devstack cinder-volume[94328]: WARNING cinder.quota [None req-028d7659-e8c9-41b5-87a8-21ddf1e37dad tempest-GroupSnapshotsTest-405720423 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-34924950 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-34924950, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:46:32 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-028d7659-e8c9-41b5-87a8-21ddf1e37dad tempest-GroupSnapshotsTest-405720423 None] Created reservations ['bb5ae555-ef78-42c5-a037-106d59ce4ac9', '84ba0b2c-c6b8-4e4a-b34b-1effe0eff7c8', 'f93ca6fa-a05e-41a7-9252-9ef50d5b4252', '1f27385c-a63d-4a9a-adb0-ef53b9462e13'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:46:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-028d7659-e8c9-41b5-87a8-21ddf1e37dad tempest-GroupSnapshotsTest-405720423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-028d7659-e8c9-41b5-87a8-21ddf1e37dad tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-028d7659-e8c9-41b5-87a8-21ddf1e37dad tempest-GroupSnapshotsTest-405720423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:46:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-028d7659-e8c9-41b5-87a8-21ddf1e37dad tempest-GroupSnapshotsTest-405720423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:46:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-028d7659-e8c9-41b5-87a8-21ddf1e37dad tempest-GroupSnapshotsTest-405720423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-028d7659-e8c9-41b5-87a8-21ddf1e37dad tempest-GroupSnapshotsTest-405720423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:32 devstack sudo[104664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:46:32 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:33 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-028d7659-e8c9-41b5-87a8-21ddf1e37dad tempest-GroupSnapshotsTest-405720423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.560s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:33 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-028d7659-e8c9-41b5-87a8-21ddf1e37dad tempest-GroupSnapshotsTest-405720423 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:46:33 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-028d7659-e8c9-41b5-87a8-21ddf1e37dad tempest-GroupSnapshotsTest-405720423 None] Delete group completed successfully. Aug 27 03:46:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-1454296c-b0a8-45ac-8d3d-f61c825e6426 req-d43afbf7-a037-404e-a852-d80c60ebf27f tempest-TestServerVolumeAttachmentScenario-2837056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-1454296c-b0a8-45ac-8d3d-f61c825e6426 req-d43afbf7-a037-404e-a852-d80c60ebf27f tempest-TestServerVolumeAttachmentScenario-2837056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-1454296c-b0a8-45ac-8d3d-f61c825e6426 req-d43afbf7-a037-404e-a852-d80c60ebf27f tempest-TestServerVolumeAttachmentScenario-2837056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-1454296c-b0a8-45ac-8d3d-f61c825e6426 req-d43afbf7-a037-404e-a852-d80c60ebf27f tempest-TestServerVolumeAttachmentScenario-2837056 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac', 'name': 'volume-6e97ff7a-2aee-467c-97ad-64a194934156', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd377c34a-2a96-41ba-83bb-e3214c607eb2', 'enforce_multipath': True} {{(pid=94328) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 27 03:46:42 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-1454296c-b0a8-45ac-8d3d-f61c825e6426 req-d43afbf7-a037-404e-a852-d80c60ebf27f tempest-TestServerVolumeAttachmentScenario-2837056 None] attachment_update completed successfully. Aug 27 03:46:43 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-db03f223-3fae-4805-94c3-72706d472c00 tempest-GroupSnapshotsV319Test-1345948525 None] Group tempest-GroupSnapshotsV319Test-Group-527788569: creating Aug 27 03:46:43 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:46:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Flow 'volume_create_manager' (a69c0e34-d4e7-497b-aa2d-e6d3b02a214a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:46:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (380d5e30-7c41-451f-884f-1970375d0b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:43 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-db03f223-3fae-4805-94c3-72706d472c00 tempest-GroupSnapshotsV319Test-1345948525 None] Group tempest-GroupSnapshotsV319Test-Group-527788569: created successfully Aug 27 03:46:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (380d5e30-7c41-451f-884f-1970375d0b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1861413876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d6d91c2-8c51-428b-80e8-65f23e663e1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ba23deffab040c7b684e6d2e56112f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:46:43Z,use_quota=True,user_id='e91d7761d5004f03bb876958cd3b459a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9b79b7-15b8-44e7-ac8c-5312bff09c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9b79b7-15b8-44e7-ac8c-5312bff09c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1accee-bde6-4a14-86e3-2de30e3d252b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1accee-bde6-4a14-86e3-2de30e3d252b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d6d91c2-8c51-428b-80e8-65f23e663e1a', 'volume_name': 'volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f851fcaf-2bfe-4b87-89db-68d25aaff448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f851fcaf-2bfe-4b87-89db-68d25aaff448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (547620c4-ca3e-4f55-ae0d-a8f7eeb9f2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:43 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Volume 6d6d91c2-8c51-428b-80e8-65f23e663e1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a', 'volume_size': 1} Aug 27 03:46:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1861413876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d6d91c2-8c51-428b-80e8-65f23e663e1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ba23deffab040c7b684e6d2e56112f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:46:43Z,use_quota=True,user_id='e91d7761d5004f03bb876958cd3b459a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:46:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Creating volume 6d6d91c2-8c51-428b-80e8-65f23e663e1a {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:46:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:46:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:46:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:46:43 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:46:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:43 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-db03f223-3fae-4805-94c3-72706d472c00 tempest-GroupSnapshotsV319Test-1345948525 None] Create group completed successfully. Aug 27 03:46:43 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a 1073741824 Aug 27 03:46:43 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:43 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a 1073741824" returned: 0 in 0.586s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:44 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a Aug 27 03:46:44 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:44 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a" returned: 0 in 0.308s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (547620c4-ca3e-4f55-ae0d-a8f7eeb9f2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66cdc0b0-78e7-494a-8d81-c22afef12ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:44 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Volume volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a (6d6d91c2-8c51-428b-80e8-65f23e663e1a): created successfully Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66cdc0b0-78e7-494a-8d81-c22afef12ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Flow 'volume_create_manager' (a69c0e34-d4e7-497b-aa2d-e6d3b02a214a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:46:44 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-646c25d0-5e9c-4077-8ecf-aee218057d31 req-d15c5711-bac8-4358-b9c2-3ec4314cbf58 tempest-VolumesSnapshotsTestJSON-811458036 None] Created volume successfully. Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Flow 'volume_create_manager' (fd632f26-93eb-40a6-9dc3-776d0049a817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e395f883-b01a-4a07-88a3-ddd2ee13476b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e395f883-b01a-4a07-88a3-ddd2ee13476b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-610464667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3739efcb-947b-49a8-af60-bfa66e310032,host='devstack@QuobyteHD#QuobyteHD',id=96821587-aff3-460e-8efc-45884ebf820e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad1555025ff441ebbc194aca206b47b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:46:45Z,use_quota=True,user_id='9d48c09d97e74d70bf96c1ec444894f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea5f6532-0d44-4c7a-a050-1a5d794bb207),volume_type_id=ea5f6532-0d44-4c7a-a050-1a5d794bb207)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc2999f-8042-4e66-8382-17e32761136e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc2999f-8042-4e66-8382-17e32761136e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f9d8f0-f7ec-495c-9868-d39b6d3a6f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f9d8f0-f7ec-495c-9868-d39b6d3a6f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96821587-aff3-460e-8efc-45884ebf820e', 'volume_name': 'volume-96821587-aff3-460e-8efc-45884ebf820e', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a060b5-4d94-46b9-a141-16b0cd3be2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a060b5-4d94-46b9-a141-16b0cd3be2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3779ba8-6487-4d6b-b93c-e007988ac70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:44 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Volume 96821587-aff3-460e-8efc-45884ebf820e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96821587-aff3-460e-8efc-45884ebf820e', 'volume_size': 1} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3739efcb-947b-49a8-af60-bfa66e310032,created_at=2026-08-27T01:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-610464667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3739efcb-947b-49a8-af60-bfa66e310032,host='devstack@QuobyteHD#QuobyteHD',id=96821587-aff3-460e-8efc-45884ebf820e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad1555025ff441ebbc194aca206b47b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:46:45Z,use_quota=True,user_id='9d48c09d97e74d70bf96c1ec444894f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea5f6532-0d44-4c7a-a050-1a5d794bb207),volume_type_id=ea5f6532-0d44-4c7a-a050-1a5d794bb207)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Creating volume 96821587-aff3-460e-8efc-45884ebf820e {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:46:44 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:46:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:44 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e 1073741824 Aug 27 03:46:44 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:45 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e 1073741824" returned: 0 in 0.608s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:45 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e Aug 27 03:46:45 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-a4c3aaef-13aa-406c-81c1-65ef22513a75 req-f715f360-e106-4081-b8e6-986f4575409a tempest-VolumesSnapshotsTestJSON-811458036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:46 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e" returned: 0 in 0.420s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:46 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:46:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-a4c3aaef-13aa-406c-81c1-65ef22513a75 req-f715f360-e106-4081-b8e6-986f4575409a tempest-VolumesSnapshotsTestJSON-811458036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.168s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3779ba8-6487-4d6b-b93c-e007988ac70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96821587-aff3-460e-8efc-45884ebf820e', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca1d2e3-897b-4ec8-94b8-dde25838a8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:46 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [req-a4c3aaef-13aa-406c-81c1-65ef22513a75 req-f715f360-e106-4081-b8e6-986f4575409a tempest-VolumesSnapshotsTestJSON-811458036 None] Creating offline snapshot 7c1b8473-d546-4130-86a0-217dd6e3fcdf of volume 6d6d91c2-8c51-428b-80e8-65f23e663e1a {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:46:46 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Volume volume-96821587-aff3-460e-8efc-45884ebf820e (96821587-aff3-460e-8efc-45884ebf820e): created successfully Aug 27 03:46:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca1d2e3-897b-4ec8-94b8-dde25838a8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Flow 'volume_create_manager' (fd632f26-93eb-40a6-9dc3-776d0049a817) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:46:46 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[f516f5f8-7ef7-42f2-b7d3-c7d97244a4b6]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:46:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-a4c3aaef-13aa-406c-81c1-65ef22513a75 req-f715f360-e106-4081-b8e6-986f4575409a tempest-VolumesSnapshotsTestJSON-811458036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:46 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-672d7e4e-3916-4174-86fc-85eeda4c4298 tempest-GroupSnapshotsV319Test-1345948525 None] Created volume successfully. Aug 27 03:46:46 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a Aug 27 03:46:46 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:46 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-a4c3aaef-13aa-406c-81c1-65ef22513a75 req-f715f360-e106-4081-b8e6-986f4575409a tempest-VolumesSnapshotsTestJSON-811458036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a" returned: 0 in 0.414s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-a4c3aaef-13aa-406c-81c1-65ef22513a75 req-f715f360-e106-4081-b8e6-986f4575409a tempest-VolumesSnapshotsTestJSON-811458036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.7c1b8473-d546-4130-86a0-217dd6e3fcdf 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:46 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.7c1b8473-d546-4130-86a0-217dd6e3fcdf 1G Aug 27 03:46:46 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:46 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-a4c3aaef-13aa-406c-81c1-65ef22513a75 req-f715f360-e106-4081-b8e6-986f4575409a tempest-VolumesSnapshotsTestJSON-811458036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.7c1b8473-d546-4130-86a0-217dd6e3fcdf 1G" returned: 0 in 0.415s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-a4c3aaef-13aa-406c-81c1-65ef22513a75 req-f715f360-e106-4081-b8e6-986f4575409a tempest-VolumesSnapshotsTestJSON-811458036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.7c1b8473-d546-4130-86a0-217dd6e3fcdf {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:46 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.7c1b8473-d546-4130-86a0-217dd6e3fcdf Aug 27 03:46:46 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:47 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-a4c3aaef-13aa-406c-81c1-65ef22513a75 req-f715f360-e106-4081-b8e6-986f4575409a tempest-VolumesSnapshotsTestJSON-811458036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.7c1b8473-d546-4130-86a0-217dd6e3fcdf" returned: 0 in 0.329s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:47 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [req-a4c3aaef-13aa-406c-81c1-65ef22513a75 req-f715f360-e106-4081-b8e6-986f4575409a tempest-VolumesSnapshotsTestJSON-811458036 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.7c1b8473-d546-4130-86a0-217dd6e3fcdf is being set with open permissions: ugo+rw Aug 27 03:46:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-a4c3aaef-13aa-406c-81c1-65ef22513a75 req-f715f360-e106-4081-b8e6-986f4575409a tempest-VolumesSnapshotsTestJSON-811458036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.7c1b8473-d546-4130-86a0-217dd6e3fcdf {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:47 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.7c1b8473-d546-4130-86a0-217dd6e3fcdf Aug 27 03:46:47 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:47 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-a4c3aaef-13aa-406c-81c1-65ef22513a75 req-f715f360-e106-4081-b8e6-986f4575409a tempest-VolumesSnapshotsTestJSON-811458036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.7c1b8473-d546-4130-86a0-217dd6e3fcdf" returned: 0 in 0.273s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-a4c3aaef-13aa-406c-81c1-65ef22513a75 req-f715f360-e106-4081-b8e6-986f4575409a tempest-VolumesSnapshotsTestJSON-811458036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:47 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.info Aug 27 03:46:47 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:47 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-4ecd1ab4-3696-47ed-aefc-5d77a2aaee13 tempest-GroupSnapshotsV319Test-1345948525 None] GroupSnapshot 0b7b3886-6dda-4e1f-96ef-98ccadc92388: creating. Aug 27 03:46:47 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4ecd1ab4-3696-47ed-aefc-5d77a2aaee13 tempest-GroupSnapshotsV319Test-1345948525 None] Group snapshot 0b7b3886-6dda-4e1f-96ef-98ccadc92388: creating. {{(pid=94328) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 27 03:46:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-9bba59a8-2abb-4e54-bcdb-354eba45ff59 req-9e5b903d-17a4-4c1a-ab83-c15d63bc1fc2 tempest-TestServerVolumeAttachmentScenario-2837056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4ecd1ab4-3696-47ed-aefc-5d77a2aaee13 tempest-GroupSnapshotsV319Test-1345948525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:47 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-a4c3aaef-13aa-406c-81c1-65ef22513a75 req-f715f360-e106-4081-b8e6-986f4575409a tempest-VolumesSnapshotsTestJSON-811458036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.info" returned: 0 in 0.263s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:47 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [req-a4c3aaef-13aa-406c-81c1-65ef22513a75 req-f715f360-e106-4081-b8e6-986f4575409a tempest-VolumesSnapshotsTestJSON-811458036 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.info is being set with open permissions: ugo+rw Aug 27 03:46:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-a4c3aaef-13aa-406c-81c1-65ef22513a75 req-f715f360-e106-4081-b8e6-986f4575409a tempest-VolumesSnapshotsTestJSON-811458036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:47 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.info Aug 27 03:46:47 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:48 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-a4c3aaef-13aa-406c-81c1-65ef22513a75 req-f715f360-e106-4081-b8e6-986f4575409a tempest-VolumesSnapshotsTestJSON-811458036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.info" returned: 0 in 0.232s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-a4c3aaef-13aa-406c-81c1-65ef22513a75 req-f715f360-e106-4081-b8e6-986f4575409a tempest-VolumesSnapshotsTestJSON-811458036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.054s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-9bba59a8-2abb-4e54-bcdb-354eba45ff59 req-9e5b903d-17a4-4c1a-ab83-c15d63bc1fc2 tempest-TestServerVolumeAttachmentScenario-2837056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.429s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-9bba59a8-2abb-4e54-bcdb-354eba45ff59 req-9e5b903d-17a4-4c1a-ab83-c15d63bc1fc2 tempest-TestServerVolumeAttachmentScenario-2837056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4ecd1ab4-3696-47ed-aefc-5d77a2aaee13 tempest-GroupSnapshotsV319Test-1345948525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.442s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:48 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-a4c3aaef-13aa-406c-81c1-65ef22513a75 req-f715f360-e106-4081-b8e6-986f4575409a tempest-VolumesSnapshotsTestJSON-811458036 None] Create snapshot completed successfully Aug 27 03:46:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-4ecd1ab4-3696-47ed-aefc-5d77a2aaee13 tempest-GroupSnapshotsV319Test-1345948525 None] Creating offline snapshot 308e5ae7-528f-4747-836c-e362a80d80d2 of volume 96821587-aff3-460e-8efc-45884ebf820e {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:46:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-9bba59a8-2abb-4e54-bcdb-354eba45ff59 req-9e5b903d-17a4-4c1a-ab83-c15d63bc1fc2 tempest-TestServerVolumeAttachmentScenario-2837056 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac', 'name': 'volume-fe66522b-0eff-44d0-88eb-30389eab0814', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c660bdb-041b-4d86-8237-3911881dfe1a', 'enforce_multipath': True} {{(pid=94328) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 27 03:46:48 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[14103508-bd2c-4441-9d23-e7afb83397b6]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:46:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4ecd1ab4-3696-47ed-aefc-5d77a2aaee13 tempest-GroupSnapshotsV319Test-1345948525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:48 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-9bba59a8-2abb-4e54-bcdb-354eba45ff59 req-9e5b903d-17a4-4c1a-ab83-c15d63bc1fc2 tempest-TestServerVolumeAttachmentScenario-2837056 None] attachment_update completed successfully. Aug 27 03:46:48 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e Aug 27 03:46:48 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-c089ad5a-c380-4ab9-8dfe-35f320b926c5 req-8970244b-b499-44e6-aba4-8d4a2f1ab4f0 tempest-VolumesSnapshotsTestJSON-811458036 None] Acquiring lock "cinder-7c1b8473-d546-4130-86a0-217dd6e3fcdf-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:46:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-c089ad5a-c380-4ab9-8dfe-35f320b926c5 req-8970244b-b499-44e6-aba4-8d4a2f1ab4f0 tempest-VolumesSnapshotsTestJSON-811458036 None] Lock "cinder-7c1b8473-d546-4130-86a0-217dd6e3fcdf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:46:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-c089ad5a-c380-4ab9-8dfe-35f320b926c5 req-8970244b-b499-44e6-aba4-8d4a2f1ab4f0 tempest-VolumesSnapshotsTestJSON-811458036 None] Acquiring lock "cinder-quobyte-6d6d91c2-8c51-428b-80e8-65f23e663e1a" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:46:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-c089ad5a-c380-4ab9-8dfe-35f320b926c5 req-8970244b-b499-44e6-aba4-8d4a2f1ab4f0 tempest-VolumesSnapshotsTestJSON-811458036 None] Lock "cinder-quobyte-6d6d91c2-8c51-428b-80e8-65f23e663e1a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:46:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-c089ad5a-c380-4ab9-8dfe-35f320b926c5 req-8970244b-b499-44e6-aba4-8d4a2f1ab4f0 tempest-VolumesSnapshotsTestJSON-811458036 None] Acquiring lock "cinder-quobyte-7c1b8473-d546-4130-86a0-217dd6e3fcdf" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:46:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-c089ad5a-c380-4ab9-8dfe-35f320b926c5 req-8970244b-b499-44e6-aba4-8d4a2f1ab4f0 tempest-VolumesSnapshotsTestJSON-811458036 None] Lock "cinder-quobyte-7c1b8473-d546-4130-86a0-217dd6e3fcdf" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:46:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [req-c089ad5a-c380-4ab9-8dfe-35f320b926c5 req-8970244b-b499-44e6-aba4-8d4a2f1ab4f0 tempest-VolumesSnapshotsTestJSON-811458036 None] Deleting offline snapshot 7c1b8473-d546-4130-86a0-217dd6e3fcdf of volume 6d6d91c2-8c51-428b-80e8-65f23e663e1a {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:46:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [req-c089ad5a-c380-4ab9-8dfe-35f320b926c5 req-8970244b-b499-44e6-aba4-8d4a2f1ab4f0 tempest-VolumesSnapshotsTestJSON-811458036 None] snapshot_file for this snap is: volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.7c1b8473-d546-4130-86a0-217dd6e3fcdf {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:46:48 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[505ac182-fb15-4eeb-be0a-dbcba333a092]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:46:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-c089ad5a-c380-4ab9-8dfe-35f320b926c5 req-8970244b-b499-44e6-aba4-8d4a2f1ab4f0 tempest-VolumesSnapshotsTestJSON-811458036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.7c1b8473-d546-4130-86a0-217dd6e3fcdf {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:48 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4ecd1ab4-3696-47ed-aefc-5d77a2aaee13 tempest-GroupSnapshotsV319Test-1345948525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e" returned: 0 in 0.437s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4ecd1ab4-3696-47ed-aefc-5d77a2aaee13 tempest-GroupSnapshotsV319Test-1345948525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.308e5ae7-528f-4747-836c-e362a80d80d2 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:48 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.308e5ae7-528f-4747-836c-e362a80d80d2 1G Aug 27 03:46:48 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:48 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.7c1b8473-d546-4130-86a0-217dd6e3fcdf Aug 27 03:46:48 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:49 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-c089ad5a-c380-4ab9-8dfe-35f320b926c5 req-8970244b-b499-44e6-aba4-8d4a2f1ab4f0 tempest-VolumesSnapshotsTestJSON-811458036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.7c1b8473-d546-4130-86a0-217dd6e3fcdf" returned: 0 in 0.434s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:49 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [req-c089ad5a-c380-4ab9-8dfe-35f320b926c5 req-8970244b-b499-44e6-aba4-8d4a2f1ab4f0 tempest-VolumesSnapshotsTestJSON-811458036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:46:49 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d79e07-e70b-4514-8a9c-51016f71d530]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:46:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-c089ad5a-c380-4ab9-8dfe-35f320b926c5 req-8970244b-b499-44e6-aba4-8d4a2f1ab4f0 tempest-VolumesSnapshotsTestJSON-811458036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:49 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4ecd1ab4-3696-47ed-aefc-5d77a2aaee13 tempest-GroupSnapshotsV319Test-1345948525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.308e5ae7-528f-4747-836c-e362a80d80d2 1G" returned: 0 in 0.517s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4ecd1ab4-3696-47ed-aefc-5d77a2aaee13 tempest-GroupSnapshotsV319Test-1345948525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96821587-aff3-460e-8efc-45884ebf820e -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.308e5ae7-528f-4747-836c-e362a80d80d2 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:49 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96821587-aff3-460e-8efc-45884ebf820e -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.308e5ae7-528f-4747-836c-e362a80d80d2 Aug 27 03:46:49 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:49 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a Aug 27 03:46:49 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:49 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:49 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-c089ad5a-c380-4ab9-8dfe-35f320b926c5 req-8970244b-b499-44e6-aba4-8d4a2f1ab4f0 tempest-VolumesSnapshotsTestJSON-811458036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a" returned: 0 in 0.370s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-c089ad5a-c380-4ab9-8dfe-35f320b926c5 req-8970244b-b499-44e6-aba4-8d4a2f1ab4f0 tempest-VolumesSnapshotsTestJSON-811458036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.7c1b8473-d546-4130-86a0-217dd6e3fcdf {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4ecd1ab4-3696-47ed-aefc-5d77a2aaee13 tempest-GroupSnapshotsV319Test-1345948525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96821587-aff3-460e-8efc-45884ebf820e -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.308e5ae7-528f-4747-836c-e362a80d80d2" returned: 0 in 0.317s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:49 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-4ecd1ab4-3696-47ed-aefc-5d77a2aaee13 tempest-GroupSnapshotsV319Test-1345948525 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.308e5ae7-528f-4747-836c-e362a80d80d2 is being set with open permissions: ugo+rw: NotImplementedError Aug 27 03:46:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4ecd1ab4-3696-47ed-aefc-5d77a2aaee13 tempest-GroupSnapshotsV319Test-1345948525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.308e5ae7-528f-4747-836c-e362a80d80d2 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:49 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.7c1b8473-d546-4130-86a0-217dd6e3fcdf Aug 27 03:46:49 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:49 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.308e5ae7-528f-4747-836c-e362a80d80d2 Aug 27 03:46:49 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:49 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4ecd1ab4-3696-47ed-aefc-5d77a2aaee13 tempest-GroupSnapshotsV319Test-1345948525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.308e5ae7-528f-4747-836c-e362a80d80d2" returned: 0 in 0.281s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4ecd1ab4-3696-47ed-aefc-5d77a2aaee13 tempest-GroupSnapshotsV319Test-1345948525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:49 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.info Aug 27 03:46:49 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:49 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-c089ad5a-c380-4ab9-8dfe-35f320b926c5 req-8970244b-b499-44e6-aba4-8d4a2f1ab4f0 tempest-VolumesSnapshotsTestJSON-811458036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.7c1b8473-d546-4130-86a0-217dd6e3fcdf" returned: 0 in 0.402s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-c089ad5a-c380-4ab9-8dfe-35f320b926c5 req-8970244b-b499-44e6-aba4-8d4a2f1ab4f0 tempest-VolumesSnapshotsTestJSON-811458036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.7c1b8473-d546-4130-86a0-217dd6e3fcdf {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:49 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.7c1b8473-d546-4130-86a0-217dd6e3fcdf Aug 27 03:46:49 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:50 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4ecd1ab4-3696-47ed-aefc-5d77a2aaee13 tempest-GroupSnapshotsV319Test-1345948525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.info" returned: 0 in 0.283s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:50 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-4ecd1ab4-3696-47ed-aefc-5d77a2aaee13 tempest-GroupSnapshotsV319Test-1345948525 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.info is being set with open permissions: ugo+rw: NotImplementedError Aug 27 03:46:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4ecd1ab4-3696-47ed-aefc-5d77a2aaee13 tempest-GroupSnapshotsV319Test-1345948525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:50 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.info Aug 27 03:46:50 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:50 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-c089ad5a-c380-4ab9-8dfe-35f320b926c5 req-8970244b-b499-44e6-aba4-8d4a2f1ab4f0 tempest-VolumesSnapshotsTestJSON-811458036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a.7c1b8473-d546-4130-86a0-217dd6e3fcdf" returned: 0 in 0.301s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-c089ad5a-c380-4ab9-8dfe-35f320b926c5 req-8970244b-b499-44e6-aba4-8d4a2f1ab4f0 tempest-VolumesSnapshotsTestJSON-811458036 None] Lock "cinder-quobyte-7c1b8473-d546-4130-86a0-217dd6e3fcdf" released by "_delete_snapshot" :: held 1.628s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:46:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-c089ad5a-c380-4ab9-8dfe-35f320b926c5 req-8970244b-b499-44e6-aba4-8d4a2f1ab4f0 tempest-VolumesSnapshotsTestJSON-811458036 None] Lock "cinder-quobyte-6d6d91c2-8c51-428b-80e8-65f23e663e1a" released by "delete_snapshot" :: held 1.653s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:46:50 devstack cinder-volume[94328]: DEBUG cinder.quota [req-c089ad5a-c380-4ab9-8dfe-35f320b926c5 req-8970244b-b499-44e6-aba4-8d4a2f1ab4f0 tempest-VolumesSnapshotsTestJSON-811458036 None] Created reservations ['ea4c13ed-c212-4d5f-a61c-31024b71c43c', 'ba66696b-e3cb-4af1-b7af-c22b612d1596', 'aa9ccddc-b99a-415f-bf76-a4940675a344', '2a7f38b8-f14c-42aa-b9d7-a1353ff27016'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:46:50 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4ecd1ab4-3696-47ed-aefc-5d77a2aaee13 tempest-GroupSnapshotsV319Test-1345948525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.info" returned: 0 in 0.272s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4ecd1ab4-3696-47ed-aefc-5d77a2aaee13 tempest-GroupSnapshotsV319Test-1345948525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.258s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:50 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-c089ad5a-c380-4ab9-8dfe-35f320b926c5 req-8970244b-b499-44e6-aba4-8d4a2f1ab4f0 tempest-VolumesSnapshotsTestJSON-811458036 None] Delete snapshot completed successfully. Aug 27 03:46:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-c089ad5a-c380-4ab9-8dfe-35f320b926c5 req-8970244b-b499-44e6-aba4-8d4a2f1ab4f0 tempest-VolumesSnapshotsTestJSON-811458036 None] Lock "cinder-7c1b8473-d546-4130-86a0-217dd6e3fcdf-delete_snapshot" released by "delete_snapshot" :: held 1.834s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:46:50 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-4ecd1ab4-3696-47ed-aefc-5d77a2aaee13 tempest-GroupSnapshotsV319Test-1345948525 None] group_snapshot 0b7b3886-6dda-4e1f-96ef-98ccadc92388: created successfully Aug 27 03:46:50 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-6eb6dd93-3fdb-427e-b7c0-13dfb6b893e7 req-d334b819-9cf6-4570-a8cf-80d51f8f557c tempest-TestServerVolumeAttachmentScenario-2837056 None] Terminate volume connection completed successfully. Aug 27 03:46:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-6eb6dd93-3fdb-427e-b7c0-13dfb6b893e7 req-d334b819-9cf6-4570-a8cf-80d51f8f557c tempest-TestServerVolumeAttachmentScenario-2837056 None] Deleting attachment 9c660bdb-041b-4d86-8237-3911881dfe1a. {{(pid=94328) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 27 03:46:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-3fd47970-ed70-4a31-8866-d92dce4d98ec req-ef558e34-7166-4cb2-8bc4-32d189b4284d tempest-VolumesSnapshotsTestJSON-811458036 None] Acquiring lock "cinder-6d6d91c2-8c51-428b-80e8-65f23e663e1a-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:46:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-3fd47970-ed70-4a31-8866-d92dce4d98ec req-ef558e34-7166-4cb2-8bc4-32d189b4284d tempest-VolumesSnapshotsTestJSON-811458036 None] Lock "cinder-6d6d91c2-8c51-428b-80e8-65f23e663e1a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:46:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-3fd47970-ed70-4a31-8866-d92dce4d98ec req-ef558e34-7166-4cb2-8bc4-32d189b4284d tempest-VolumesSnapshotsTestJSON-811458036 None] Acquiring lock "cinder-quobyte-6d6d91c2-8c51-428b-80e8-65f23e663e1a" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:46:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-3fd47970-ed70-4a31-8866-d92dce4d98ec req-ef558e34-7166-4cb2-8bc4-32d189b4284d tempest-VolumesSnapshotsTestJSON-811458036 None] Lock "cinder-quobyte-6d6d91c2-8c51-428b-80e8-65f23e663e1a" acquired by "delete_volume" :: waited 0.019s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:46:50 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[219cfd1d-7ac5-461f-9b13-0bdc1b2a70aa]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:46:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-3fd47970-ed70-4a31-8866-d92dce4d98ec req-ef558e34-7166-4cb2-8bc4-32d189b4284d tempest-VolumesSnapshotsTestJSON-811458036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:51 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a Aug 27 03:46:51 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:51 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-eb48916a-4946-4781-afad-f4ba1ab945cf tempest-GroupSnapshotsV319Test-1345948525 None] group_snapshot 0b7b3886-6dda-4e1f-96ef-98ccadc92388: deleting Aug 27 03:46:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-eb48916a-4946-4781-afad-f4ba1ab945cf tempest-GroupSnapshotsV319Test-1345948525 None] group_snapshot 0b7b3886-6dda-4e1f-96ef-98ccadc92388: deleting {{(pid=94328) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 27 03:46:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-eb48916a-4946-4781-afad-f4ba1ab945cf tempest-GroupSnapshotsV319Test-1345948525 None] Acquiring lock "cinder-quobyte-96821587-aff3-460e-8efc-45884ebf820e" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:46:51 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-3fd47970-ed70-4a31-8866-d92dce4d98ec req-ef558e34-7166-4cb2-8bc4-32d189b4284d tempest-VolumesSnapshotsTestJSON-811458036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a" returned: 0 in 0.450s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-3fd47970-ed70-4a31-8866-d92dce4d98ec req-ef558e34-7166-4cb2-8bc4-32d189b4284d tempest-VolumesSnapshotsTestJSON-811458036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-eb48916a-4946-4781-afad-f4ba1ab945cf tempest-GroupSnapshotsV319Test-1345948525 None] Lock "cinder-quobyte-96821587-aff3-460e-8efc-45884ebf820e" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:46:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-eb48916a-4946-4781-afad-f4ba1ab945cf tempest-GroupSnapshotsV319Test-1345948525 None] Acquiring lock "cinder-quobyte-308e5ae7-528f-4747-836c-e362a80d80d2" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:46:51 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a Aug 27 03:46:51 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-eb48916a-4946-4781-afad-f4ba1ab945cf tempest-GroupSnapshotsV319Test-1345948525 None] Lock "cinder-quobyte-308e5ae7-528f-4747-836c-e362a80d80d2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:46:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-eb48916a-4946-4781-afad-f4ba1ab945cf tempest-GroupSnapshotsV319Test-1345948525 None] Deleting offline snapshot 308e5ae7-528f-4747-836c-e362a80d80d2 of volume 96821587-aff3-460e-8efc-45884ebf820e {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:46:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-eb48916a-4946-4781-afad-f4ba1ab945cf tempest-GroupSnapshotsV319Test-1345948525 None] snapshot_file for this snap is: volume-96821587-aff3-460e-8efc-45884ebf820e.308e5ae7-528f-4747-836c-e362a80d80d2 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:46:51 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd32cda9-0cbd-47b2-a11e-a3536cb69dba]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:46:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-eb48916a-4946-4781-afad-f4ba1ab945cf tempest-GroupSnapshotsV319Test-1345948525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.308e5ae7-528f-4747-836c-e362a80d80d2 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:51 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.308e5ae7-528f-4747-836c-e362a80d80d2 Aug 27 03:46:51 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:51 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-3fd47970-ed70-4a31-8866-d92dce4d98ec req-ef558e34-7166-4cb2-8bc4-32d189b4284d tempest-VolumesSnapshotsTestJSON-811458036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d6d91c2-8c51-428b-80e8-65f23e663e1a" returned: 0 in 0.311s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-3fd47970-ed70-4a31-8866-d92dce4d98ec req-ef558e34-7166-4cb2-8bc4-32d189b4284d tempest-VolumesSnapshotsTestJSON-811458036 None] Lock "cinder-quobyte-6d6d91c2-8c51-428b-80e8-65f23e663e1a" released by "delete_volume" :: held 0.831s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:46:51 devstack cinder-volume[94328]: DEBUG cinder.quota [req-3fd47970-ed70-4a31-8866-d92dce4d98ec req-ef558e34-7166-4cb2-8bc4-32d189b4284d tempest-VolumesSnapshotsTestJSON-811458036 None] Created reservations ['8580f019-8c40-455c-9191-5d7e3b16c8f1', 'c6fa3301-9fc8-4458-a0cd-6be59259de7e', '00bf3c8f-a6b6-4950-8d9a-bef6930dfa08', '0d0b486b-9b32-4860-a3cd-c31af8e94571'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:46:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-3fd47970-ed70-4a31-8866-d92dce4d98ec req-ef558e34-7166-4cb2-8bc4-32d189b4284d tempest-VolumesSnapshotsTestJSON-811458036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-3fd47970-ed70-4a31-8866-d92dce4d98ec req-ef558e34-7166-4cb2-8bc4-32d189b4284d tempest-VolumesSnapshotsTestJSON-811458036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [req-3fd47970-ed70-4a31-8866-d92dce4d98ec req-ef558e34-7166-4cb2-8bc4-32d189b4284d tempest-VolumesSnapshotsTestJSON-811458036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:46:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [req-3fd47970-ed70-4a31-8866-d92dce4d98ec req-ef558e34-7166-4cb2-8bc4-32d189b4284d tempest-VolumesSnapshotsTestJSON-811458036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:46:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-3fd47970-ed70-4a31-8866-d92dce4d98ec req-ef558e34-7166-4cb2-8bc4-32d189b4284d tempest-VolumesSnapshotsTestJSON-811458036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-3fd47970-ed70-4a31-8866-d92dce4d98ec req-ef558e34-7166-4cb2-8bc4-32d189b4284d tempest-VolumesSnapshotsTestJSON-811458036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:51 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:46:51 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:51 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-eb48916a-4946-4781-afad-f4ba1ab945cf tempest-GroupSnapshotsV319Test-1345948525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.308e5ae7-528f-4747-836c-e362a80d80d2" returned: 0 in 0.484s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-eb48916a-4946-4781-afad-f4ba1ab945cf tempest-GroupSnapshotsV319Test-1345948525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96821587-aff3-460e-8efc-45884ebf820e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:46:52 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7217fc-9fc8-4bec-b005-4446749799c5]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:46:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-eb48916a-4946-4781-afad-f4ba1ab945cf tempest-GroupSnapshotsV319Test-1345948525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:52 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e Aug 27 03:46:52 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:52 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-a6c15f1a-ac2f-4194-bc8a-a112fb147ff1 req-ce06b67f-413c-4a98-b9a3-6136908cfa8f tempest-TestServerVolumeAttachmentScenario-2837056 None] Terminate volume connection completed successfully. Aug 27 03:46:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-a6c15f1a-ac2f-4194-bc8a-a112fb147ff1 req-ce06b67f-413c-4a98-b9a3-6136908cfa8f tempest-TestServerVolumeAttachmentScenario-2837056 None] Deleting attachment d377c34a-2a96-41ba-83bb-e3214c607eb2. {{(pid=94328) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 27 03:46:52 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-3fd47970-ed70-4a31-8866-d92dce4d98ec req-ef558e34-7166-4cb2-8bc4-32d189b4284d tempest-VolumesSnapshotsTestJSON-811458036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.350s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:52 devstack cinder-volume[94328]: DEBUG cinder.manager [req-3fd47970-ed70-4a31-8866-d92dce4d98ec req-ef558e34-7166-4cb2-8bc4-32d189b4284d tempest-VolumesSnapshotsTestJSON-811458036 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:46:52 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-3fd47970-ed70-4a31-8866-d92dce4d98ec req-ef558e34-7166-4cb2-8bc4-32d189b4284d tempest-VolumesSnapshotsTestJSON-811458036 None] Deleted volume successfully. Aug 27 03:46:52 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-3fd47970-ed70-4a31-8866-d92dce4d98ec req-ef558e34-7166-4cb2-8bc4-32d189b4284d tempest-VolumesSnapshotsTestJSON-811458036 None] Lock "cinder-6d6d91c2-8c51-428b-80e8-65f23e663e1a-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:46:52 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-eb48916a-4946-4781-afad-f4ba1ab945cf tempest-GroupSnapshotsV319Test-1345948525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e" returned: 0 in 0.455s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-eb48916a-4946-4781-afad-f4ba1ab945cf tempest-GroupSnapshotsV319Test-1345948525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.308e5ae7-528f-4747-836c-e362a80d80d2 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:52 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.308e5ae7-528f-4747-836c-e362a80d80d2 Aug 27 03:46:52 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:52 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-eb48916a-4946-4781-afad-f4ba1ab945cf tempest-GroupSnapshotsV319Test-1345948525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.308e5ae7-528f-4747-836c-e362a80d80d2" returned: 0 in 0.403s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-eb48916a-4946-4781-afad-f4ba1ab945cf tempest-GroupSnapshotsV319Test-1345948525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.308e5ae7-528f-4747-836c-e362a80d80d2 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:52 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.308e5ae7-528f-4747-836c-e362a80d80d2 Aug 27 03:46:52 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:53 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-eb48916a-4946-4781-afad-f4ba1ab945cf tempest-GroupSnapshotsV319Test-1345948525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e.308e5ae7-528f-4747-836c-e362a80d80d2" returned: 0 in 0.335s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:53 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-eb48916a-4946-4781-afad-f4ba1ab945cf tempest-GroupSnapshotsV319Test-1345948525 None] Lock "cinder-quobyte-308e5ae7-528f-4747-836c-e362a80d80d2" released by "_delete_snapshot" :: held 1.858s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:46:53 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-eb48916a-4946-4781-afad-f4ba1ab945cf tempest-GroupSnapshotsV319Test-1345948525 None] Lock "cinder-quobyte-96821587-aff3-460e-8efc-45884ebf820e" released by "delete_snapshot" :: held 1.890s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:46:53 devstack cinder-volume[94328]: WARNING cinder.quota [None req-eb48916a-4946-4781-afad-f4ba1ab945cf tempest-GroupSnapshotsV319Test-1345948525 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-937971748 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-937971748, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:46:53 devstack cinder-volume[94328]: WARNING cinder.quota [None req-eb48916a-4946-4781-afad-f4ba1ab945cf tempest-GroupSnapshotsV319Test-1345948525 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-937971748 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-937971748, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:46:53 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-eb48916a-4946-4781-afad-f4ba1ab945cf tempest-GroupSnapshotsV319Test-1345948525 None] Created reservations ['f0490402-e85f-40d6-99bc-6049ea4cd47c', '9b479ded-dbdf-4dcd-ac56-8ab6aead37d7', '75a6e9be-b714-45fb-a51d-60088d9b5076', '06a2423c-9e1e-4031-955a-5edd1ccd5628'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:46:53 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-eb48916a-4946-4781-afad-f4ba1ab945cf tempest-GroupSnapshotsV319Test-1345948525 None] group_snapshot 0b7b3886-6dda-4e1f-96ef-98ccadc92388: deleted successfully Aug 27 03:46:54 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-43f53cb8-3168-410b-bf63-c73b2485fea6 tempest-GroupSnapshotsV319Test-1345948525 None] Acquiring lock "cinder-quobyte-96821587-aff3-460e-8efc-45884ebf820e" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:46:54 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-43f53cb8-3168-410b-bf63-c73b2485fea6 tempest-GroupSnapshotsV319Test-1345948525 None] Lock "cinder-quobyte-96821587-aff3-460e-8efc-45884ebf820e" acquired by "delete_volume" :: waited 0.026s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:46:54 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8226639-52e6-4463-8ca1-fac8a6e0ac0b]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:46:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-43f53cb8-3168-410b-bf63-c73b2485fea6 tempest-GroupSnapshotsV319Test-1345948525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:54 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e Aug 27 03:46:54 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:55 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-43f53cb8-3168-410b-bf63-c73b2485fea6 tempest-GroupSnapshotsV319Test-1345948525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e" returned: 0 in 0.592s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-43f53cb8-3168-410b-bf63-c73b2485fea6 tempest-GroupSnapshotsV319Test-1345948525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:55 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e Aug 27 03:46:55 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:55 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-43f53cb8-3168-410b-bf63-c73b2485fea6 tempest-GroupSnapshotsV319Test-1345948525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-96821587-aff3-460e-8efc-45884ebf820e" returned: 0 in 0.310s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:55 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-43f53cb8-3168-410b-bf63-c73b2485fea6 tempest-GroupSnapshotsV319Test-1345948525 None] Lock "cinder-quobyte-96821587-aff3-460e-8efc-45884ebf820e" released by "delete_volume" :: held 1.016s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:46:55 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-43f53cb8-3168-410b-bf63-c73b2485fea6 tempest-GroupSnapshotsV319Test-1345948525 None] Created reservations ['6c8b1d00-3bd5-4eca-a88a-f789817929eb'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:46:55 devstack cinder-volume[94328]: WARNING cinder.quota [None req-43f53cb8-3168-410b-bf63-c73b2485fea6 tempest-GroupSnapshotsV319Test-1345948525 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-937971748 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-937971748, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:46:55 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-43f53cb8-3168-410b-bf63-c73b2485fea6 tempest-GroupSnapshotsV319Test-1345948525 None] Created reservations ['dae34bdb-05cc-4edc-aad6-f80163e0ea26', '60dcb4fe-5009-45b9-ac0b-2235138c97ec', '4a7a527c-cb8c-4210-800d-27517730b66b', '8f935516-721c-4913-94cc-ee765be5eb51'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:46:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-43f53cb8-3168-410b-bf63-c73b2485fea6 tempest-GroupSnapshotsV319Test-1345948525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-43f53cb8-3168-410b-bf63-c73b2485fea6 tempest-GroupSnapshotsV319Test-1345948525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-43f53cb8-3168-410b-bf63-c73b2485fea6 tempest-GroupSnapshotsV319Test-1345948525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:46:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-43f53cb8-3168-410b-bf63-c73b2485fea6 tempest-GroupSnapshotsV319Test-1345948525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:46:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-43f53cb8-3168-410b-bf63-c73b2485fea6 tempest-GroupSnapshotsV319Test-1345948525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-43f53cb8-3168-410b-bf63-c73b2485fea6 tempest-GroupSnapshotsV319Test-1345948525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:55 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:46:55 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:55 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-43f53cb8-3168-410b-bf63-c73b2485fea6 tempest-GroupSnapshotsV319Test-1345948525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.337s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:55 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-43f53cb8-3168-410b-bf63-c73b2485fea6 tempest-GroupSnapshotsV319Test-1345948525 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:46:56 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-43f53cb8-3168-410b-bf63-c73b2485fea6 tempest-GroupSnapshotsV319Test-1345948525 None] Delete group completed successfully. Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Flow 'volume_create_manager' (5c2c8253-da3b-459f-84f9-5ba61d0396a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb03ad6-ec8d-4536-ac42-4bbb2a8704d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb03ad6-ec8d-4536-ac42-4bbb2a8704d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-20569746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e0696bc-aceb-4ce8-ac86-68985f626ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f3fb4bd8d7465b82c18cfd8fece208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:46:58Z,use_quota=True,user_id='51dc585b1b3240f9884aae1d03e2e63b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d51ba4f-8ce3-419e-a0f3-2d6f59f6e867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d51ba4f-8ce3-419e-a0f3-2d6f59f6e867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df9b5790-38c2-4480-a969-5f9e53f9a335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df9b5790-38c2-4480-a969-5f9e53f9a335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e0696bc-aceb-4ce8-ac86-68985f626ea5', 'volume_name': 'volume-5e0696bc-aceb-4ce8-ac86-68985f626ea5', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f06c2ff-64b5-43be-b6ca-611ab79030a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f06c2ff-64b5-43be-b6ca-611ab79030a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f06914af-2313-4fc4-bc32-88ffae15b895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:58 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Volume 5e0696bc-aceb-4ce8-ac86-68985f626ea5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e0696bc-aceb-4ce8-ac86-68985f626ea5', 'volume_size': 1} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-20569746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e0696bc-aceb-4ce8-ac86-68985f626ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f3fb4bd8d7465b82c18cfd8fece208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:46:58Z,use_quota=True,user_id='51dc585b1b3240f9884aae1d03e2e63b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Creating volume 5e0696bc-aceb-4ce8-ac86-68985f626ea5 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:46:58 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e0696bc-aceb-4ce8-ac86-68985f626ea5 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:58 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e0696bc-aceb-4ce8-ac86-68985f626ea5 1073741824 Aug 27 03:46:58 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5edae2f3-171a-41d3-a696-932edfdfbbda tempest-TestServerVolumeAttachmentScenario-2837056 None] Acquiring lock "cinder-fe66522b-0eff-44d0-88eb-30389eab0814-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5edae2f3-171a-41d3-a696-932edfdfbbda tempest-TestServerVolumeAttachmentScenario-2837056 None] Lock "cinder-fe66522b-0eff-44d0-88eb-30389eab0814-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5edae2f3-171a-41d3-a696-932edfdfbbda tempest-TestServerVolumeAttachmentScenario-2837056 None] Acquiring lock "cinder-quobyte-fe66522b-0eff-44d0-88eb-30389eab0814" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5edae2f3-171a-41d3-a696-932edfdfbbda tempest-TestServerVolumeAttachmentScenario-2837056 None] Lock "cinder-quobyte-fe66522b-0eff-44d0-88eb-30389eab0814" acquired by "delete_volume" :: waited 0.032s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[3875345d-9e95-4be8-a54e-188aa20b10a1]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:46:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5edae2f3-171a-41d3-a696-932edfdfbbda tempest-TestServerVolumeAttachmentScenario-2837056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fe66522b-0eff-44d0-88eb-30389eab0814 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:59 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fe66522b-0eff-44d0-88eb-30389eab0814 Aug 27 03:46:59 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:59 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e0696bc-aceb-4ce8-ac86-68985f626ea5 1073741824" returned: 0 in 0.660s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e0696bc-aceb-4ce8-ac86-68985f626ea5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:59 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e0696bc-aceb-4ce8-ac86-68985f626ea5 Aug 27 03:46:59 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:59 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5edae2f3-171a-41d3-a696-932edfdfbbda tempest-TestServerVolumeAttachmentScenario-2837056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fe66522b-0eff-44d0-88eb-30389eab0814" returned: 0 in 0.588s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5edae2f3-171a-41d3-a696-932edfdfbbda tempest-TestServerVolumeAttachmentScenario-2837056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fe66522b-0eff-44d0-88eb-30389eab0814 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:59 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fe66522b-0eff-44d0-88eb-30389eab0814 Aug 27 03:46:59 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:46:59 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e0696bc-aceb-4ce8-ac86-68985f626ea5" returned: 0 in 0.321s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:46:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f06914af-2313-4fc4-bc32-88ffae15b895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e0696bc-aceb-4ce8-ac86-68985f626ea5', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb72bebf-537b-4c5b-b317-d9b2548ac31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:46:59 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Volume volume-5e0696bc-aceb-4ce8-ac86-68985f626ea5 (5e0696bc-aceb-4ce8-ac86-68985f626ea5): created successfully Aug 27 03:46:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb72bebf-537b-4c5b-b317-d9b2548ac31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:46:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Flow 'volume_create_manager' (5c2c8253-da3b-459f-84f9-5ba61d0396a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:46:59 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-cbab64c7-466b-4a0b-bc8d-e71579bfc799 tempest-AttachVolumeNegativeTest-1215284800 None] Created volume successfully. Aug 27 03:46:59 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Aug 27 03:46:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5edae2f3-171a-41d3-a696-932edfdfbbda tempest-TestServerVolumeAttachmentScenario-2837056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fe66522b-0eff-44d0-88eb-30389eab0814" returned: 0 in 0.327s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:46:59 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5edae2f3-171a-41d3-a696-932edfdfbbda tempest-TestServerVolumeAttachmentScenario-2837056 None] Lock "cinder-quobyte-fe66522b-0eff-44d0-88eb-30389eab0814" released by "delete_volume" :: held 0.978s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:46:59 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-5edae2f3-171a-41d3-a696-932edfdfbbda tempest-TestServerVolumeAttachmentScenario-2837056 None] Created reservations ['a47a2993-008c-4422-bf99-4f2c2d88e6ba', 'bf170256-ec92-49eb-b723-9450868f13d0', '1c6303a3-9f6c-4291-8040-51377a1c1b3c', '1bc25b9a-92db-40dd-b03a-967896014b9c'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:46:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5edae2f3-171a-41d3-a696-932edfdfbbda tempest-TestServerVolumeAttachmentScenario-2837056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:46:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5edae2f3-171a-41d3-a696-932edfdfbbda tempest-TestServerVolumeAttachmentScenario-2837056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:46:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5edae2f3-171a-41d3-a696-932edfdfbbda tempest-TestServerVolumeAttachmentScenario-2837056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:46:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5edae2f3-171a-41d3-a696-932edfdfbbda tempest-TestServerVolumeAttachmentScenario-2837056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:46:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5edae2f3-171a-41d3-a696-932edfdfbbda tempest-TestServerVolumeAttachmentScenario-2837056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:46:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5edae2f3-171a-41d3-a696-932edfdfbbda tempest-TestServerVolumeAttachmentScenario-2837056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:46:59 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:46:59 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:00 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5edae2f3-171a-41d3-a696-932edfdfbbda tempest-TestServerVolumeAttachmentScenario-2837056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.319s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:00 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-5edae2f3-171a-41d3-a696-932edfdfbbda tempest-TestServerVolumeAttachmentScenario-2837056 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:47:00 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-5edae2f3-171a-41d3-a696-932edfdfbbda tempest-TestServerVolumeAttachmentScenario-2837056 None] Deleted volume successfully. Aug 27 03:47:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5edae2f3-171a-41d3-a696-932edfdfbbda tempest-TestServerVolumeAttachmentScenario-2837056 None] Lock "cinder-fe66522b-0eff-44d0-88eb-30389eab0814-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:01 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0b1c7941-ce3d-4258-b02d-d79595f1d1aa tempest-TestServerVolumeAttachmentScenario-2837056 None] Acquiring lock "cinder-6e97ff7a-2aee-467c-97ad-64a194934156-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:01 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0b1c7941-ce3d-4258-b02d-d79595f1d1aa tempest-TestServerVolumeAttachmentScenario-2837056 None] Lock "cinder-6e97ff7a-2aee-467c-97ad-64a194934156-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:01 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0b1c7941-ce3d-4258-b02d-d79595f1d1aa tempest-TestServerVolumeAttachmentScenario-2837056 None] Acquiring lock "cinder-quobyte-6e97ff7a-2aee-467c-97ad-64a194934156" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:01 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0b1c7941-ce3d-4258-b02d-d79595f1d1aa tempest-TestServerVolumeAttachmentScenario-2837056 None] Lock "cinder-quobyte-6e97ff7a-2aee-467c-97ad-64a194934156" acquired by "delete_volume" :: waited 0.033s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:01 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad18da6-e782-4252-84a4-4ae4d22ce9a7]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:47:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0b1c7941-ce3d-4258-b02d-d79595f1d1aa tempest-TestServerVolumeAttachmentScenario-2837056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6e97ff7a-2aee-467c-97ad-64a194934156 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:01 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6e97ff7a-2aee-467c-97ad-64a194934156 Aug 27 03:47:01 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-38e3d5b7-f269-4dd7-8b3b-6750490f62b3 req-6642b529-5c38-4b1e-a5a0-27ef1ad7d0cf tempest-AttachVolumeNegativeTest-1215284800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-38e3d5b7-f269-4dd7-8b3b-6750490f62b3 req-6642b529-5c38-4b1e-a5a0-27ef1ad7d0cf tempest-AttachVolumeNegativeTest-1215284800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-38e3d5b7-f269-4dd7-8b3b-6750490f62b3 req-6642b529-5c38-4b1e-a5a0-27ef1ad7d0cf tempest-AttachVolumeNegativeTest-1215284800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-38e3d5b7-f269-4dd7-8b3b-6750490f62b3 req-6642b529-5c38-4b1e-a5a0-27ef1ad7d0cf tempest-AttachVolumeNegativeTest-1215284800 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac', 'name': 'volume-5e0696bc-aceb-4ce8-ac86-68985f626ea5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '281098da-d717-4908-aeba-cbc082001b1a', 'enforce_multipath': True} {{(pid=94328) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 27 03:47:01 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0b1c7941-ce3d-4258-b02d-d79595f1d1aa tempest-TestServerVolumeAttachmentScenario-2837056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6e97ff7a-2aee-467c-97ad-64a194934156" returned: 0 in 0.486s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0b1c7941-ce3d-4258-b02d-d79595f1d1aa tempest-TestServerVolumeAttachmentScenario-2837056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6e97ff7a-2aee-467c-97ad-64a194934156 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:01 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6e97ff7a-2aee-467c-97ad-64a194934156 Aug 27 03:47:01 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:01 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-38e3d5b7-f269-4dd7-8b3b-6750490f62b3 req-6642b529-5c38-4b1e-a5a0-27ef1ad7d0cf tempest-AttachVolumeNegativeTest-1215284800 None] attachment_update completed successfully. Aug 27 03:47:02 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0b1c7941-ce3d-4258-b02d-d79595f1d1aa tempest-TestServerVolumeAttachmentScenario-2837056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6e97ff7a-2aee-467c-97ad-64a194934156" returned: 0 in 0.427s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0b1c7941-ce3d-4258-b02d-d79595f1d1aa tempest-TestServerVolumeAttachmentScenario-2837056 None] Lock "cinder-quobyte-6e97ff7a-2aee-467c-97ad-64a194934156" released by "delete_volume" :: held 0.976s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:02 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-0b1c7941-ce3d-4258-b02d-d79595f1d1aa tempest-TestServerVolumeAttachmentScenario-2837056 None] Created reservations ['ca627a7b-1b58-4ae7-9272-c886c5e0e28b', 'd76f1b16-29db-464f-9004-a76c4e8e1de2', '823fe249-9646-41dc-96d4-1bf524085f97', '58f6aa18-9a5d-482b-b333-6eb8e01712c8'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:47:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0b1c7941-ce3d-4258-b02d-d79595f1d1aa tempest-TestServerVolumeAttachmentScenario-2837056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0b1c7941-ce3d-4258-b02d-d79595f1d1aa tempest-TestServerVolumeAttachmentScenario-2837056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:02 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0b1c7941-ce3d-4258-b02d-d79595f1d1aa tempest-TestServerVolumeAttachmentScenario-2837056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:47:02 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0b1c7941-ce3d-4258-b02d-d79595f1d1aa tempest-TestServerVolumeAttachmentScenario-2837056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:47:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0b1c7941-ce3d-4258-b02d-d79595f1d1aa tempest-TestServerVolumeAttachmentScenario-2837056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0b1c7941-ce3d-4258-b02d-d79595f1d1aa tempest-TestServerVolumeAttachmentScenario-2837056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:02 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:47:02 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:02 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0b1c7941-ce3d-4258-b02d-d79595f1d1aa tempest-TestServerVolumeAttachmentScenario-2837056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.327s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:02 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-0b1c7941-ce3d-4258-b02d-d79595f1d1aa tempest-TestServerVolumeAttachmentScenario-2837056 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:47:02 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-0b1c7941-ce3d-4258-b02d-d79595f1d1aa tempest-TestServerVolumeAttachmentScenario-2837056 None] Deleted volume successfully. Aug 27 03:47:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0b1c7941-ce3d-4258-b02d-d79595f1d1aa tempest-TestServerVolumeAttachmentScenario-2837056 None] Lock "cinder-6e97ff7a-2aee-467c-97ad-64a194934156-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:03 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-aed33e77-8328-4c1e-8b2e-cb62bce017db tempest-GroupsV320Test-1211251878 None] Group tempest-GroupsV320Test-Group-1050792254: creating Aug 27 03:47:03 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-aed33e77-8328-4c1e-8b2e-cb62bce017db tempest-GroupsV320Test-1211251878 None] Group tempest-GroupsV320Test-Group-1050792254: created successfully Aug 27 03:47:03 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-aed33e77-8328-4c1e-8b2e-cb62bce017db tempest-GroupsV320Test-1211251878 None] Create group completed successfully. Aug 27 03:47:04 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-0573e80d-38ed-4255-9153-a6c6093b9189 req-74cf47c2-3c84-4736-824d-4cdca0b1fcee tempest-AttachVolumeNegativeTest-1215284800 None] Terminate volume connection completed successfully. Aug 27 03:47:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-0573e80d-38ed-4255-9153-a6c6093b9189 req-74cf47c2-3c84-4736-824d-4cdca0b1fcee tempest-AttachVolumeNegativeTest-1215284800 None] Deleting attachment 281098da-d717-4908-aeba-cbc082001b1a. {{(pid=94328) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 27 03:47:05 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-4ca1977b-3b9d-46a2-93d0-6b13a8ef13a3 tempest-GroupsV320Test-1211251878 None] Created reservations ['4818ad0b-5049-4ec4-a4f3-5b63b307e643'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:47:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4ca1977b-3b9d-46a2-93d0-6b13a8ef13a3 tempest-GroupsV320Test-1211251878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4ca1977b-3b9d-46a2-93d0-6b13a8ef13a3 tempest-GroupsV320Test-1211251878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4ca1977b-3b9d-46a2-93d0-6b13a8ef13a3 tempest-GroupsV320Test-1211251878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:47:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4ca1977b-3b9d-46a2-93d0-6b13a8ef13a3 tempest-GroupsV320Test-1211251878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:47:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4ca1977b-3b9d-46a2-93d0-6b13a8ef13a3 tempest-GroupsV320Test-1211251878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4ca1977b-3b9d-46a2-93d0-6b13a8ef13a3 tempest-GroupsV320Test-1211251878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:05 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:47:05 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:05 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4ca1977b-3b9d-46a2-93d0-6b13a8ef13a3 tempest-GroupsV320Test-1211251878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.368s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:05 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4ca1977b-3b9d-46a2-93d0-6b13a8ef13a3 tempest-GroupsV320Test-1211251878 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:47:05 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-4ca1977b-3b9d-46a2-93d0-6b13a8ef13a3 tempest-GroupsV320Test-1211251878 None] Delete group completed successfully. Aug 27 03:47:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f29d978c-1109-4a80-b128-d92706ea2a24 tempest-AttachVolumeNegativeTest-1215284800 None] Acquiring lock "cinder-5e0696bc-aceb-4ce8-ac86-68985f626ea5-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f29d978c-1109-4a80-b128-d92706ea2a24 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "cinder-5e0696bc-aceb-4ce8-ac86-68985f626ea5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f29d978c-1109-4a80-b128-d92706ea2a24 tempest-AttachVolumeNegativeTest-1215284800 None] Acquiring lock "cinder-quobyte-5e0696bc-aceb-4ce8-ac86-68985f626ea5" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f29d978c-1109-4a80-b128-d92706ea2a24 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "cinder-quobyte-5e0696bc-aceb-4ce8-ac86-68985f626ea5" acquired by "delete_volume" :: waited 0.048s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:11 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[13093ffb-1999-4913-8202-b43902e6b35a]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:47:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f29d978c-1109-4a80-b128-d92706ea2a24 tempest-AttachVolumeNegativeTest-1215284800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e0696bc-aceb-4ce8-ac86-68985f626ea5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:11 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e0696bc-aceb-4ce8-ac86-68985f626ea5 Aug 27 03:47:11 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:11 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f29d978c-1109-4a80-b128-d92706ea2a24 tempest-AttachVolumeNegativeTest-1215284800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e0696bc-aceb-4ce8-ac86-68985f626ea5" returned: 0 in 0.552s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f29d978c-1109-4a80-b128-d92706ea2a24 tempest-AttachVolumeNegativeTest-1215284800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e0696bc-aceb-4ce8-ac86-68985f626ea5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:11 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e0696bc-aceb-4ce8-ac86-68985f626ea5 Aug 27 03:47:11 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:12 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f29d978c-1109-4a80-b128-d92706ea2a24 tempest-AttachVolumeNegativeTest-1215284800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e0696bc-aceb-4ce8-ac86-68985f626ea5" returned: 0 in 0.346s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f29d978c-1109-4a80-b128-d92706ea2a24 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "cinder-quobyte-5e0696bc-aceb-4ce8-ac86-68985f626ea5" released by "delete_volume" :: held 0.974s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:12 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-f29d978c-1109-4a80-b128-d92706ea2a24 tempest-AttachVolumeNegativeTest-1215284800 None] Created reservations ['ff46f75e-696b-4598-84ff-fa1bab7704fa', '65180a35-15a9-4ac6-8d7a-cd517e775373', 'b0a684f1-ef24-4b41-84dc-6d6a43357f45', '2101aa55-891e-44e3-a6da-f7384f72ac52'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:47:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f29d978c-1109-4a80-b128-d92706ea2a24 tempest-AttachVolumeNegativeTest-1215284800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f29d978c-1109-4a80-b128-d92706ea2a24 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f29d978c-1109-4a80-b128-d92706ea2a24 tempest-AttachVolumeNegativeTest-1215284800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:47:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f29d978c-1109-4a80-b128-d92706ea2a24 tempest-AttachVolumeNegativeTest-1215284800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:47:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f29d978c-1109-4a80-b128-d92706ea2a24 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f29d978c-1109-4a80-b128-d92706ea2a24 tempest-AttachVolumeNegativeTest-1215284800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:12 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:47:12 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:12 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f29d978c-1109-4a80-b128-d92706ea2a24 tempest-AttachVolumeNegativeTest-1215284800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.429s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:12 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-f29d978c-1109-4a80-b128-d92706ea2a24 tempest-AttachVolumeNegativeTest-1215284800 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:47:12 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f29d978c-1109-4a80-b128-d92706ea2a24 tempest-AttachVolumeNegativeTest-1215284800 None] Deleted volume successfully. Aug 27 03:47:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f29d978c-1109-4a80-b128-d92706ea2a24 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "cinder-5e0696bc-aceb-4ce8-ac86-68985f626ea5-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-da90455a-13a1-48bb-aaed-7738d0490181 tempest-AttachVolumeNegativeTest-1215284800 None] Acquiring lock "cinder-57d84b20-9ed3-4c35-a042-ef86b08b1ef5-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-da90455a-13a1-48bb-aaed-7738d0490181 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "cinder-57d84b20-9ed3-4c35-a042-ef86b08b1ef5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-da90455a-13a1-48bb-aaed-7738d0490181 tempest-AttachVolumeNegativeTest-1215284800 None] Acquiring lock "cinder-quobyte-57d84b20-9ed3-4c35-a042-ef86b08b1ef5" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-da90455a-13a1-48bb-aaed-7738d0490181 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "cinder-quobyte-57d84b20-9ed3-4c35-a042-ef86b08b1ef5" acquired by "delete_volume" :: waited 0.023s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:13 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f86a57-035d-4f30-901f-6f8a528a6156]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:47:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-da90455a-13a1-48bb-aaed-7738d0490181 tempest-AttachVolumeNegativeTest-1215284800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-57d84b20-9ed3-4c35-a042-ef86b08b1ef5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:13 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-57d84b20-9ed3-4c35-a042-ef86b08b1ef5 Aug 27 03:47:13 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:14 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-da90455a-13a1-48bb-aaed-7738d0490181 tempest-AttachVolumeNegativeTest-1215284800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-57d84b20-9ed3-4c35-a042-ef86b08b1ef5" returned: 0 in 0.510s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-da90455a-13a1-48bb-aaed-7738d0490181 tempest-AttachVolumeNegativeTest-1215284800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-57d84b20-9ed3-4c35-a042-ef86b08b1ef5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:14 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-57d84b20-9ed3-4c35-a042-ef86b08b1ef5 Aug 27 03:47:14 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:14 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-da90455a-13a1-48bb-aaed-7738d0490181 tempest-AttachVolumeNegativeTest-1215284800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-57d84b20-9ed3-4c35-a042-ef86b08b1ef5" returned: 0 in 0.363s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:14 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-da90455a-13a1-48bb-aaed-7738d0490181 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "cinder-quobyte-57d84b20-9ed3-4c35-a042-ef86b08b1ef5" released by "delete_volume" :: held 0.935s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:14 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-da90455a-13a1-48bb-aaed-7738d0490181 tempest-AttachVolumeNegativeTest-1215284800 None] Created reservations ['55a19aa3-4efd-4a01-9308-bfea17caa46f', '65102cc0-35e8-4d22-8dda-ff689570ad27', '3c867549-2287-4512-840e-11d805f3f447', '89b5c316-9be4-41b5-b1cc-ad516bf0730b'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:47:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-da90455a-13a1-48bb-aaed-7738d0490181 tempest-AttachVolumeNegativeTest-1215284800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-da90455a-13a1-48bb-aaed-7738d0490181 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-da90455a-13a1-48bb-aaed-7738d0490181 tempest-AttachVolumeNegativeTest-1215284800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:47:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-da90455a-13a1-48bb-aaed-7738d0490181 tempest-AttachVolumeNegativeTest-1215284800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:47:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-da90455a-13a1-48bb-aaed-7738d0490181 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-da90455a-13a1-48bb-aaed-7738d0490181 tempest-AttachVolumeNegativeTest-1215284800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:14 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:47:14 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:14 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:47:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:47:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:47:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:14 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:47:14 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:15 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-da90455a-13a1-48bb-aaed-7738d0490181 tempest-AttachVolumeNegativeTest-1215284800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.363s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-da90455a-13a1-48bb-aaed-7738d0490181 tempest-AttachVolumeNegativeTest-1215284800 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:47:15 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-da90455a-13a1-48bb-aaed-7738d0490181 tempest-AttachVolumeNegativeTest-1215284800 None] Deleted volume successfully. Aug 27 03:47:15 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-da90455a-13a1-48bb-aaed-7738d0490181 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "cinder-57d84b20-9ed3-4c35-a042-ef86b08b1ef5-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:15 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.351s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:47:15 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager._thread_info {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:47:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread count: 28 {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 03:47:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread info: [<_MainThread(MainThread, started 134250325188736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 03:47:15 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Flow 'volume_create_manager' (8a7ec266-eda0-43d9-9b70-66a66ed99d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (205c532e-2c77-449d-b0bb-cd3f86a9c942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (205c532e-2c77-449d-b0bb-cd3f86a9c942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-512768217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de0f9c6e-93cb-4c54-8382-7fbec56a7f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07e99c314c74d84a2ad93b8ba973645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:47:16Z,use_quota=True,user_id='9e29df00a1254bf8b2a05095211bd01f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5305fd02-2cbb-4a27-a6c2-420a38c47d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5305fd02-2cbb-4a27-a6c2-420a38c47d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af039517-55b8-4b57-b4d5-e949241dad73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af039517-55b8-4b57-b4d5-e949241dad73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de0f9c6e-93cb-4c54-8382-7fbec56a7f8d', 'volume_name': 'volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba7c86e1-8058-4e52-a067-ffe74c6cd0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba7c86e1-8058-4e52-a067-ffe74c6cd0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3f9962-ad9f-4882-a3a4-7a4734e2b7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:16 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Volume de0f9c6e-93cb-4c54-8382-7fbec56a7f8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d', 'volume_size': 1} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-512768217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de0f9c6e-93cb-4c54-8382-7fbec56a7f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07e99c314c74d84a2ad93b8ba973645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:47:16Z,use_quota=True,user_id='9e29df00a1254bf8b2a05095211bd01f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Creating volume de0f9c6e-93cb-4c54-8382-7fbec56a7f8d {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:47:16 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d1a1354a-8d10-4fdb-be50-2a9a982298b9 tempest-AttachVolumeNegativeTest-1215284800 None] Acquiring lock "cinder-d50be3fe-b793-4f35-91d4-4941874e870c-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:16 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d 1073741824 Aug 27 03:47:16 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d1a1354a-8d10-4fdb-be50-2a9a982298b9 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "cinder-d50be3fe-b793-4f35-91d4-4941874e870c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d1a1354a-8d10-4fdb-be50-2a9a982298b9 tempest-AttachVolumeNegativeTest-1215284800 None] Acquiring lock "cinder-quobyte-d50be3fe-b793-4f35-91d4-4941874e870c" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d1a1354a-8d10-4fdb-be50-2a9a982298b9 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "cinder-quobyte-d50be3fe-b793-4f35-91d4-4941874e870c" acquired by "delete_volume" :: waited 0.027s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d97638b-9f75-45dd-8158-523055e15edb]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d1a1354a-8d10-4fdb-be50-2a9a982298b9 tempest-AttachVolumeNegativeTest-1215284800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d50be3fe-b793-4f35-91d4-4941874e870c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:16 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d50be3fe-b793-4f35-91d4-4941874e870c Aug 27 03:47:16 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:16 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d 1073741824" returned: 0 in 0.656s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:16 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d1a1354a-8d10-4fdb-be50-2a9a982298b9 tempest-AttachVolumeNegativeTest-1215284800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d50be3fe-b793-4f35-91d4-4941874e870c" returned: 0 in 0.551s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d1a1354a-8d10-4fdb-be50-2a9a982298b9 tempest-AttachVolumeNegativeTest-1215284800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d50be3fe-b793-4f35-91d4-4941874e870c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:16 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d Aug 27 03:47:16 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:16 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d50be3fe-b793-4f35-91d4-4941874e870c Aug 27 03:47:16 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:17 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d" returned: 0 in 0.342s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:17 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:47:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:17 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3f9962-ad9f-4882-a3a4-7a4734e2b7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:17 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c6c808-28b5-4690-acf9-7acf912e2e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:17 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:17 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Volume volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d (de0f9c6e-93cb-4c54-8382-7fbec56a7f8d): created successfully Aug 27 03:47:17 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c6c808-28b5-4690-acf9-7acf912e2e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:17 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Flow 'volume_create_manager' (8a7ec266-eda0-43d9-9b70-66a66ed99d61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:47:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d1a1354a-8d10-4fdb-be50-2a9a982298b9 tempest-AttachVolumeNegativeTest-1215284800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d50be3fe-b793-4f35-91d4-4941874e870c" returned: 0 in 0.393s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:17 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d1a1354a-8d10-4fdb-be50-2a9a982298b9 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "cinder-quobyte-d50be3fe-b793-4f35-91d4-4941874e870c" released by "delete_volume" :: held 1.002s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:17 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-521dc69c-6aad-44e9-b341-af420119c6b3 tempest-SnapshotsActionsTest-1790596406 None] Created volume successfully. Aug 27 03:47:17 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-d1a1354a-8d10-4fdb-be50-2a9a982298b9 tempest-AttachVolumeNegativeTest-1215284800 None] Created reservations ['9cc6a8e2-90ac-4727-acde-55c6e2dbfd73', 'f611e951-935b-40de-96b8-2bf7bbcd426f', 'abf0a85c-209f-40dd-9ec4-744e859f90b0', 'bace771c-cc72-4d7b-9f7f-aba191334d8c'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:47:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d1a1354a-8d10-4fdb-be50-2a9a982298b9 tempest-AttachVolumeNegativeTest-1215284800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d1a1354a-8d10-4fdb-be50-2a9a982298b9 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:17 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d1a1354a-8d10-4fdb-be50-2a9a982298b9 tempest-AttachVolumeNegativeTest-1215284800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:47:17 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d1a1354a-8d10-4fdb-be50-2a9a982298b9 tempest-AttachVolumeNegativeTest-1215284800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:47:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d1a1354a-8d10-4fdb-be50-2a9a982298b9 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d1a1354a-8d10-4fdb-be50-2a9a982298b9 tempest-AttachVolumeNegativeTest-1215284800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:17 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:47:17 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:17 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d1a1354a-8d10-4fdb-be50-2a9a982298b9 tempest-AttachVolumeNegativeTest-1215284800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.339s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:17 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-d1a1354a-8d10-4fdb-be50-2a9a982298b9 tempest-AttachVolumeNegativeTest-1215284800 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:47:17 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d1a1354a-8d10-4fdb-be50-2a9a982298b9 tempest-AttachVolumeNegativeTest-1215284800 None] Deleted volume successfully. Aug 27 03:47:17 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d1a1354a-8d10-4fdb-be50-2a9a982298b9 tempest-AttachVolumeNegativeTest-1215284800 None] Lock "cinder-d50be3fe-b793-4f35-91d4-4941874e870c-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-70aa33f8-543c-42cb-8994-081f9c8d2294 tempest-SnapshotsActionsTest-1790596406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-70aa33f8-543c-42cb-8994-081f9c8d2294 tempest-SnapshotsActionsTest-1790596406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-70aa33f8-543c-42cb-8994-081f9c8d2294 tempest-SnapshotsActionsTest-1790596406 None] Creating offline snapshot 9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af of volume de0f9c6e-93cb-4c54-8382-7fbec56a7f8d {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:47:18 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[785dcba5-1da0-431a-a7b9-1f182ac2462e]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:47:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-70aa33f8-543c-42cb-8994-081f9c8d2294 tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:18 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d Aug 27 03:47:18 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:18 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-70aa33f8-543c-42cb-8994-081f9c8d2294 tempest-SnapshotsActionsTest-1790596406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d" returned: 0 in 0.494s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-70aa33f8-543c-42cb-8994-081f9c8d2294 tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:18 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af 1G Aug 27 03:47:18 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:19 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-70aa33f8-543c-42cb-8994-081f9c8d2294 tempest-SnapshotsActionsTest-1790596406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af 1G" returned: 0 in 0.615s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-70aa33f8-543c-42cb-8994-081f9c8d2294 tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:19 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af Aug 27 03:47:19 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:19 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-70aa33f8-543c-42cb-8994-081f9c8d2294 tempest-SnapshotsActionsTest-1790596406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af" returned: 0 in 0.361s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:19 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-70aa33f8-543c-42cb-8994-081f9c8d2294 tempest-SnapshotsActionsTest-1790596406 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af is being set with open permissions: ugo+rw Aug 27 03:47:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-70aa33f8-543c-42cb-8994-081f9c8d2294 tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:19 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af Aug 27 03:47:19 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:20 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-70aa33f8-543c-42cb-8994-081f9c8d2294 tempest-SnapshotsActionsTest-1790596406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af" returned: 0 in 0.344s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-70aa33f8-543c-42cb-8994-081f9c8d2294 tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:20 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.info Aug 27 03:47:20 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:20 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-70aa33f8-543c-42cb-8994-081f9c8d2294 tempest-SnapshotsActionsTest-1790596406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.info" returned: 0 in 0.365s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:20 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-70aa33f8-543c-42cb-8994-081f9c8d2294 tempest-SnapshotsActionsTest-1790596406 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.info is being set with open permissions: ugo+rw Aug 27 03:47:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-70aa33f8-543c-42cb-8994-081f9c8d2294 tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:20 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.info Aug 27 03:47:20 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:20 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-70aa33f8-543c-42cb-8994-081f9c8d2294 tempest-SnapshotsActionsTest-1790596406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.info" returned: 0 in 0.311s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-70aa33f8-543c-42cb-8994-081f9c8d2294 tempest-SnapshotsActionsTest-1790596406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.639s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:21 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-70aa33f8-543c-42cb-8994-081f9c8d2294 tempest-SnapshotsActionsTest-1790596406 None] Create snapshot completed successfully Aug 27 03:47:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-20e9e721-eda8-4a50-8539-79b95242a95a tempest-SnapshotsActionsTest-1790596406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-20e9e721-eda8-4a50-8539-79b95242a95a tempest-SnapshotsActionsTest-1790596406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-20e9e721-eda8-4a50-8539-79b95242a95a tempest-SnapshotsActionsTest-1790596406 None] Creating offline snapshot fb662b83-115b-4149-a358-c1a6ab6c5757 of volume de0f9c6e-93cb-4c54-8382-7fbec56a7f8d {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:47:22 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b06da7e-3751-4136-98dd-74d88fc01118]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:47:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-20e9e721-eda8-4a50-8539-79b95242a95a tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:22 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af Aug 27 03:47:22 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:22 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-20e9e721-eda8-4a50-8539-79b95242a95a tempest-SnapshotsActionsTest-1790596406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af" returned: 0 in 0.411s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-20e9e721-eda8-4a50-8539-79b95242a95a tempest-SnapshotsActionsTest-1790596406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:47:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-20e9e721-eda8-4a50-8539-79b95242a95a tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.fb662b83-115b-4149-a358-c1a6ab6c5757 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:22 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.fb662b83-115b-4149-a358-c1a6ab6c5757 1G Aug 27 03:47:22 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:23 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-20e9e721-eda8-4a50-8539-79b95242a95a tempest-SnapshotsActionsTest-1790596406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.fb662b83-115b-4149-a358-c1a6ab6c5757 1G" returned: 0 in 0.608s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-20e9e721-eda8-4a50-8539-79b95242a95a tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.fb662b83-115b-4149-a358-c1a6ab6c5757 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:23 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.fb662b83-115b-4149-a358-c1a6ab6c5757 Aug 27 03:47:23 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:23 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-20e9e721-eda8-4a50-8539-79b95242a95a tempest-SnapshotsActionsTest-1790596406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.fb662b83-115b-4149-a358-c1a6ab6c5757" returned: 0 in 0.371s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:23 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-20e9e721-eda8-4a50-8539-79b95242a95a tempest-SnapshotsActionsTest-1790596406 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.fb662b83-115b-4149-a358-c1a6ab6c5757 is being set with open permissions: ugo+rw Aug 27 03:47:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-20e9e721-eda8-4a50-8539-79b95242a95a tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.fb662b83-115b-4149-a358-c1a6ab6c5757 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:23 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.fb662b83-115b-4149-a358-c1a6ab6c5757 Aug 27 03:47:23 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:24 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-20e9e721-eda8-4a50-8539-79b95242a95a tempest-SnapshotsActionsTest-1790596406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.fb662b83-115b-4149-a358-c1a6ab6c5757" returned: 0 in 0.374s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-20e9e721-eda8-4a50-8539-79b95242a95a tempest-SnapshotsActionsTest-1790596406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.926s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:24 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-20e9e721-eda8-4a50-8539-79b95242a95a tempest-SnapshotsActionsTest-1790596406 None] Create snapshot completed successfully Aug 27 03:47:24 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-97e67857-2b8d-49a9-b0bd-005b41c19768 tempest-SnapshotsActionsTest-478912589 None] Acquiring lock "cinder-fb662b83-115b-4149-a358-c1a6ab6c5757-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:24 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-97e67857-2b8d-49a9-b0bd-005b41c19768 tempest-SnapshotsActionsTest-478912589 None] Lock "cinder-fb662b83-115b-4149-a358-c1a6ab6c5757-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:24 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-97e67857-2b8d-49a9-b0bd-005b41c19768 tempest-SnapshotsActionsTest-478912589 None] Acquiring lock "cinder-quobyte-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:24 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-97e67857-2b8d-49a9-b0bd-005b41c19768 tempest-SnapshotsActionsTest-478912589 None] Lock "cinder-quobyte-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:24 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-97e67857-2b8d-49a9-b0bd-005b41c19768 tempest-SnapshotsActionsTest-478912589 None] Acquiring lock "cinder-quobyte-fb662b83-115b-4149-a358-c1a6ab6c5757" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:24 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-97e67857-2b8d-49a9-b0bd-005b41c19768 tempest-SnapshotsActionsTest-478912589 None] Lock "cinder-quobyte-fb662b83-115b-4149-a358-c1a6ab6c5757" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-97e67857-2b8d-49a9-b0bd-005b41c19768 tempest-SnapshotsActionsTest-478912589 None] Deleting offline snapshot fb662b83-115b-4149-a358-c1a6ab6c5757 of volume de0f9c6e-93cb-4c54-8382-7fbec56a7f8d {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:47:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-97e67857-2b8d-49a9-b0bd-005b41c19768 tempest-SnapshotsActionsTest-478912589 None] snapshot_file for this snap is: volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.fb662b83-115b-4149-a358-c1a6ab6c5757 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:47:24 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b48cd1-f91c-48a0-9aa3-10e64267807f]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:47:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-97e67857-2b8d-49a9-b0bd-005b41c19768 tempest-SnapshotsActionsTest-478912589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.fb662b83-115b-4149-a358-c1a6ab6c5757 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:24 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.fb662b83-115b-4149-a358-c1a6ab6c5757 Aug 27 03:47:24 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:25 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-97e67857-2b8d-49a9-b0bd-005b41c19768 tempest-SnapshotsActionsTest-478912589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.fb662b83-115b-4149-a358-c1a6ab6c5757" returned: 0 in 0.474s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:25 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-97e67857-2b8d-49a9-b0bd-005b41c19768 tempest-SnapshotsActionsTest-478912589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:47:25 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73a76c7-3916-4911-a645-8eec04e1b6d2]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:47:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-97e67857-2b8d-49a9-b0bd-005b41c19768 tempest-SnapshotsActionsTest-478912589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:25 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af Aug 27 03:47:25 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:25 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-97e67857-2b8d-49a9-b0bd-005b41c19768 tempest-SnapshotsActionsTest-478912589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af" returned: 0 in 0.444s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:25 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-97e67857-2b8d-49a9-b0bd-005b41c19768 tempest-SnapshotsActionsTest-478912589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:47:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-97e67857-2b8d-49a9-b0bd-005b41c19768 tempest-SnapshotsActionsTest-478912589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.fb662b83-115b-4149-a358-c1a6ab6c5757 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:25 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.fb662b83-115b-4149-a358-c1a6ab6c5757 Aug 27 03:47:25 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:26 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-97e67857-2b8d-49a9-b0bd-005b41c19768 tempest-SnapshotsActionsTest-478912589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.fb662b83-115b-4149-a358-c1a6ab6c5757" returned: 0 in 0.564s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-97e67857-2b8d-49a9-b0bd-005b41c19768 tempest-SnapshotsActionsTest-478912589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.fb662b83-115b-4149-a358-c1a6ab6c5757 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:26 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.fb662b83-115b-4149-a358-c1a6ab6c5757 Aug 27 03:47:26 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:26 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-97e67857-2b8d-49a9-b0bd-005b41c19768 tempest-SnapshotsActionsTest-478912589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.fb662b83-115b-4149-a358-c1a6ab6c5757" returned: 0 in 0.302s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-97e67857-2b8d-49a9-b0bd-005b41c19768 tempest-SnapshotsActionsTest-478912589 None] Lock "cinder-quobyte-fb662b83-115b-4149-a358-c1a6ab6c5757" released by "_delete_snapshot" :: held 1.908s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-97e67857-2b8d-49a9-b0bd-005b41c19768 tempest-SnapshotsActionsTest-478912589 None] Lock "cinder-quobyte-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d" released by "delete_snapshot" :: held 1.943s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:26 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-97e67857-2b8d-49a9-b0bd-005b41c19768 tempest-SnapshotsActionsTest-478912589 None] Created reservations ['744be892-fbe7-444f-962a-21453e70096d', 'eb7a641a-365a-4df7-a7d2-e87ee162ec4d', '166f47f0-9337-4314-b796-5eae10e9c5f0', 'dad799e9-215e-4245-be16-e0f27134b027'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:47:26 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-97e67857-2b8d-49a9-b0bd-005b41c19768 tempest-SnapshotsActionsTest-478912589 None] Delete snapshot completed successfully. Aug 27 03:47:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-97e67857-2b8d-49a9-b0bd-005b41c19768 tempest-SnapshotsActionsTest-478912589 None] Lock "cinder-fb662b83-115b-4149-a358-c1a6ab6c5757-delete_snapshot" released by "delete_snapshot" :: held 2.181s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6cf48d1a-619b-4221-9748-b6bc8fd2138a tempest-SnapshotsActionsTest-1790596406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6cf48d1a-619b-4221-9748-b6bc8fd2138a tempest-SnapshotsActionsTest-1790596406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:28 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-6cf48d1a-619b-4221-9748-b6bc8fd2138a tempest-SnapshotsActionsTest-1790596406 None] Creating offline snapshot 69ca9df3-7a44-4b3b-856c-e64c6534d9be of volume de0f9c6e-93cb-4c54-8382-7fbec56a7f8d {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:47:28 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dad655c-28b1-43d7-bbb6-9b43887f593c]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:47:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6cf48d1a-619b-4221-9748-b6bc8fd2138a tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:28 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af Aug 27 03:47:28 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:28 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:47:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Flow 'volume_create_manager' (8e6f83f0-98b1-4a0a-a6d2-6d11a285446c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:47:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6cf7b76-9cf3-4662-bf53-6f8153f5b27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6cf7b76-9cf3-4662-bf53-6f8153f5b27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-466056943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5c55062-92a3-4115-bcfb-849607f508c7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67396cfef02341268d674039024b88fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:47:29Z,use_quota=True,user_id='a84710da953047c7a8e2f37cac30ed5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e5d609a-2d0a-4e51-8a7c-feaf6342e636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e5d609a-2d0a-4e51-8a7c-feaf6342e636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b348b050-045e-40a6-a36f-46d02b92dfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b348b050-045e-40a6-a36f-46d02b92dfda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5c55062-92a3-4115-bcfb-849607f508c7', 'volume_name': 'volume-f5c55062-92a3-4115-bcfb-849607f508c7', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecddffd2-bfe7-47b8-b263-0295b8bb4972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecddffd2-bfe7-47b8-b263-0295b8bb4972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9ce3bb-4b96-4559-b07a-e87d11608a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:28 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Volume f5c55062-92a3-4115-bcfb-849607f508c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5c55062-92a3-4115-bcfb-849607f508c7', 'volume_size': 1} Aug 27 03:47:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:29 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6cf48d1a-619b-4221-9748-b6bc8fd2138a tempest-SnapshotsActionsTest-1790596406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af" returned: 0 in 0.482s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-6cf48d1a-619b-4221-9748-b6bc8fd2138a tempest-SnapshotsActionsTest-1790596406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:47:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6cf48d1a-619b-4221-9748-b6bc8fd2138a tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.69ca9df3-7a44-4b3b-856c-e64c6534d9be 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:29 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.69ca9df3-7a44-4b3b-856c-e64c6534d9be 1G Aug 27 03:47:29 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:29 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6cf48d1a-619b-4221-9748-b6bc8fd2138a tempest-SnapshotsActionsTest-1790596406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.69ca9df3-7a44-4b3b-856c-e64c6534d9be 1G" returned: 0 in 0.622s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6cf48d1a-619b-4221-9748-b6bc8fd2138a tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.69ca9df3-7a44-4b3b-856c-e64c6534d9be {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:29 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.69ca9df3-7a44-4b3b-856c-e64c6534d9be Aug 27 03:47:29 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:30 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6cf48d1a-619b-4221-9748-b6bc8fd2138a tempest-SnapshotsActionsTest-1790596406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.69ca9df3-7a44-4b3b-856c-e64c6534d9be" returned: 0 in 0.394s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:30 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-6cf48d1a-619b-4221-9748-b6bc8fd2138a tempest-SnapshotsActionsTest-1790596406 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.69ca9df3-7a44-4b3b-856c-e64c6534d9be is being set with open permissions: ugo+rw Aug 27 03:47:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6cf48d1a-619b-4221-9748-b6bc8fd2138a tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.69ca9df3-7a44-4b3b-856c-e64c6534d9be {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:30 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.69ca9df3-7a44-4b3b-856c-e64c6534d9be Aug 27 03:47:30 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:30 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6cf48d1a-619b-4221-9748-b6bc8fd2138a tempest-SnapshotsActionsTest-1790596406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.69ca9df3-7a44-4b3b-856c-e64c6534d9be" returned: 0 in 0.320s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:30 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=125,cinder:INSERT=30,cinder:UPDATE=120,cinder:DELETE=7 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:47:30 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=125,cinder:INSERT=28,cinder:UPDATE=121,cinder:DELETE=6 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:47:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6cf48d1a-619b-4221-9748-b6bc8fd2138a tempest-SnapshotsActionsTest-1790596406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.982s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.530s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-466056943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5c55062-92a3-4115-bcfb-849607f508c7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67396cfef02341268d674039024b88fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:47:29Z,use_quota=True,user_id='a84710da953047c7a8e2f37cac30ed5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:47:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Creating volume f5c55062-92a3-4115-bcfb-849607f508c7 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:47:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:47:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:47:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:47:30 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:47:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5c55062-92a3-4115-bcfb-849607f508c7 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:30 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-6cf48d1a-619b-4221-9748-b6bc8fd2138a tempest-SnapshotsActionsTest-1790596406 None] Create snapshot completed successfully Aug 27 03:47:30 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5c55062-92a3-4115-bcfb-849607f508c7 1073741824 Aug 27 03:47:30 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:31 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5c55062-92a3-4115-bcfb-849607f508c7 1073741824" returned: 0 in 0.564s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5c55062-92a3-4115-bcfb-849607f508c7 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:31 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5c55062-92a3-4115-bcfb-849607f508c7 Aug 27 03:47:31 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:31 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5c55062-92a3-4115-bcfb-849607f508c7" returned: 0 in 0.326s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:31 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:47:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9ce3bb-4b96-4559-b07a-e87d11608a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5c55062-92a3-4115-bcfb-849607f508c7', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91a3c94-84fa-4031-a6cb-19ac9bf0b740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:31 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Volume volume-f5c55062-92a3-4115-bcfb-849607f508c7 (f5c55062-92a3-4115-bcfb-849607f508c7): created successfully Aug 27 03:47:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91a3c94-84fa-4031-a6cb-19ac9bf0b740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Flow 'volume_create_manager' (8e6f83f0-98b1-4a0a-a6d2-6d11a285446c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:47:31 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-b5281304-d313-4010-9703-fcd945f1efbd tempest-VolumesTestJSON-1081738474 None] Created volume successfully. Aug 27 03:47:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-68d9ecf3-1964-4535-9c91-9436f688160a tempest-SnapshotsActionsTest-478912589 None] Acquiring lock "cinder-69ca9df3-7a44-4b3b-856c-e64c6534d9be-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-68d9ecf3-1964-4535-9c91-9436f688160a tempest-SnapshotsActionsTest-478912589 None] Lock "cinder-69ca9df3-7a44-4b3b-856c-e64c6534d9be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-68d9ecf3-1964-4535-9c91-9436f688160a tempest-SnapshotsActionsTest-478912589 None] Acquiring lock "cinder-quobyte-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-68d9ecf3-1964-4535-9c91-9436f688160a tempest-SnapshotsActionsTest-478912589 None] Lock "cinder-quobyte-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d" acquired by "delete_snapshot" :: waited 0.037s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-68d9ecf3-1964-4535-9c91-9436f688160a tempest-SnapshotsActionsTest-478912589 None] Acquiring lock "cinder-quobyte-69ca9df3-7a44-4b3b-856c-e64c6534d9be" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-68d9ecf3-1964-4535-9c91-9436f688160a tempest-SnapshotsActionsTest-478912589 None] Lock "cinder-quobyte-69ca9df3-7a44-4b3b-856c-e64c6534d9be" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:31 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-68d9ecf3-1964-4535-9c91-9436f688160a tempest-SnapshotsActionsTest-478912589 None] Deleting offline snapshot 69ca9df3-7a44-4b3b-856c-e64c6534d9be of volume de0f9c6e-93cb-4c54-8382-7fbec56a7f8d {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:47:31 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-68d9ecf3-1964-4535-9c91-9436f688160a tempest-SnapshotsActionsTest-478912589 None] snapshot_file for this snap is: volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.69ca9df3-7a44-4b3b-856c-e64c6534d9be {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:47:32 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[8991aab0-8cd7-433e-8b4a-25e7bcbd5168]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:47:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-68d9ecf3-1964-4535-9c91-9436f688160a tempest-SnapshotsActionsTest-478912589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.69ca9df3-7a44-4b3b-856c-e64c6534d9be {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:32 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.69ca9df3-7a44-4b3b-856c-e64c6534d9be Aug 27 03:47:32 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:32 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-68d9ecf3-1964-4535-9c91-9436f688160a tempest-SnapshotsActionsTest-478912589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.69ca9df3-7a44-4b3b-856c-e64c6534d9be" returned: 0 in 0.577s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-68d9ecf3-1964-4535-9c91-9436f688160a tempest-SnapshotsActionsTest-478912589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:47:32 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a509b2f-77f8-4df8-8ea9-5dd418032602]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:47:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-68d9ecf3-1964-4535-9c91-9436f688160a tempest-SnapshotsActionsTest-478912589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:32 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af Aug 27 03:47:32 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:32 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Flow 'volume_create_manager' (0178cf77-ab9c-4f3b-a20a-22a60bbf7cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (364db8e4-e6c4-4f90-a166-6fda24b101b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (364db8e4-e6c4-4f90-a166-6fda24b101b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-929791675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e1247b3-828b-4b7b-96ce-974db488af05,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67396cfef02341268d674039024b88fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:47:33Z,use_quota=True,user_id='a84710da953047c7a8e2f37cac30ed5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d938d07-f53d-45e4-b38e-fc4bef9dc666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d938d07-f53d-45e4-b38e-fc4bef9dc666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8969eb97-9e65-44bc-8d3c-89c127a1033d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8969eb97-9e65-44bc-8d3c-89c127a1033d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e1247b3-828b-4b7b-96ce-974db488af05', 'volume_name': 'volume-1e1247b3-828b-4b7b-96ce-974db488af05', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2cc418-f28a-4f50-bde9-db0479db8931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2cc418-f28a-4f50-bde9-db0479db8931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c34e152-2735-45be-b4c3-ab055df7837f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:33 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Volume 1e1247b3-828b-4b7b-96ce-974db488af05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e1247b3-828b-4b7b-96ce-974db488af05', 'volume_size': 1} Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-929791675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e1247b3-828b-4b7b-96ce-974db488af05,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67396cfef02341268d674039024b88fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:47:33Z,use_quota=True,user_id='a84710da953047c7a8e2f37cac30ed5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Creating volume 1e1247b3-828b-4b7b-96ce-974db488af05 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:47:33 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-1e1247b3-828b-4b7b-96ce-974db488af05 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:33 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-1e1247b3-828b-4b7b-96ce-974db488af05 1073741824 Aug 27 03:47:33 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:33 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-68d9ecf3-1964-4535-9c91-9436f688160a tempest-SnapshotsActionsTest-478912589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af" returned: 0 in 0.533s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-68d9ecf3-1964-4535-9c91-9436f688160a tempest-SnapshotsActionsTest-478912589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-68d9ecf3-1964-4535-9c91-9436f688160a tempest-SnapshotsActionsTest-478912589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.69ca9df3-7a44-4b3b-856c-e64c6534d9be {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:33 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.69ca9df3-7a44-4b3b-856c-e64c6534d9be Aug 27 03:47:33 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:33 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-1e1247b3-828b-4b7b-96ce-974db488af05 1073741824" returned: 0 in 0.619s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:33 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-68d9ecf3-1964-4535-9c91-9436f688160a tempest-SnapshotsActionsTest-478912589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.69ca9df3-7a44-4b3b-856c-e64c6534d9be" returned: 0 in 0.633s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-68d9ecf3-1964-4535-9c91-9436f688160a tempest-SnapshotsActionsTest-478912589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.69ca9df3-7a44-4b3b-856c-e64c6534d9be {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:33 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.69ca9df3-7a44-4b3b-856c-e64c6534d9be Aug 27 03:47:33 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-1e1247b3-828b-4b7b-96ce-974db488af05 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:33 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-1e1247b3-828b-4b7b-96ce-974db488af05 Aug 27 03:47:33 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:34 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-68d9ecf3-1964-4535-9c91-9436f688160a tempest-SnapshotsActionsTest-478912589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.69ca9df3-7a44-4b3b-856c-e64c6534d9be" returned: 0 in 0.376s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-68d9ecf3-1964-4535-9c91-9436f688160a tempest-SnapshotsActionsTest-478912589 None] Lock "cinder-quobyte-69ca9df3-7a44-4b3b-856c-e64c6534d9be" released by "_delete_snapshot" :: held 2.340s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-68d9ecf3-1964-4535-9c91-9436f688160a tempest-SnapshotsActionsTest-478912589 None] Lock "cinder-quobyte-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d" released by "delete_snapshot" :: held 2.389s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:34 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-1e1247b3-828b-4b7b-96ce-974db488af05" returned: 0 in 0.370s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:47:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c34e152-2735-45be-b4c3-ab055df7837f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e1247b3-828b-4b7b-96ce-974db488af05', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52760dac-1faf-4d6d-bfc4-1d62425a33d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:34 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Volume volume-1e1247b3-828b-4b7b-96ce-974db488af05 (1e1247b3-828b-4b7b-96ce-974db488af05): created successfully Aug 27 03:47:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52760dac-1faf-4d6d-bfc4-1d62425a33d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Flow 'volume_create_manager' (0178cf77-ab9c-4f3b-a20a-22a60bbf7cfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:47:34 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-68d9ecf3-1964-4535-9c91-9436f688160a tempest-SnapshotsActionsTest-478912589 None] Created reservations ['469b617d-bada-4709-af76-cd2607dda778', '073dc3d0-7041-48e2-8ce1-35812a62c742', '2241c900-29cb-4d85-88fa-986c99f08abe', 'e2244ada-15b2-4711-ac2e-cde858f1f42c'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:47:34 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e0f6ab73-400d-4036-9191-ef993c7e0b77 tempest-VolumesTestJSON-1081738474 None] Created volume successfully. Aug 27 03:47:34 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-68d9ecf3-1964-4535-9c91-9436f688160a tempest-SnapshotsActionsTest-478912589 None] Delete snapshot completed successfully. Aug 27 03:47:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-68d9ecf3-1964-4535-9c91-9436f688160a tempest-SnapshotsActionsTest-478912589 None] Lock "cinder-69ca9df3-7a44-4b3b-856c-e64c6534d9be-delete_snapshot" released by "delete_snapshot" :: held 2.609s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-16b2cdb2-a1a2-47c6-9557-849155a4dd0e tempest-SnapshotsActionsTest-1790596406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-16b2cdb2-a1a2-47c6-9557-849155a4dd0e tempest-SnapshotsActionsTest-1790596406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-16b2cdb2-a1a2-47c6-9557-849155a4dd0e tempest-SnapshotsActionsTest-1790596406 None] Creating offline snapshot c0e413cd-dd57-4ce8-8822-475328dc7bb4 of volume de0f9c6e-93cb-4c54-8382-7fbec56a7f8d {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:47:35 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1531695-61b2-4008-ab31-121e91535fee]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:47:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-16b2cdb2-a1a2-47c6-9557-849155a4dd0e tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:35 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:47:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Flow 'volume_create_manager' (169c9d0c-a6d8-469c-910c-85ed1717cf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:47:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5411dd7-dd95-4a60-936a-3ea56d63ad30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:35 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af Aug 27 03:47:35 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5411dd7-dd95-4a60-936a-3ea56d63ad30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-461413946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=881deef0-bf19-4644-87a8-6fae7288b01f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67396cfef02341268d674039024b88fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:47:36Z,use_quota=True,user_id='a84710da953047c7a8e2f37cac30ed5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc164dc4-3ece-43ea-b29c-84b3a8482da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc164dc4-3ece-43ea-b29c-84b3a8482da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79181dd1-ad2f-4fd7-a49e-bea06bf69dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79181dd1-ad2f-4fd7-a49e-bea06bf69dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '881deef0-bf19-4644-87a8-6fae7288b01f', 'volume_name': 'volume-881deef0-bf19-4644-87a8-6fae7288b01f', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d98d7102-ccea-49dd-adf1-5c532748fc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d98d7102-ccea-49dd-adf1-5c532748fc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93fb0419-c81b-4eef-849e-8503dc4c426a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:35 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Volume 881deef0-bf19-4644-87a8-6fae7288b01f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-881deef0-bf19-4644-87a8-6fae7288b01f', 'volume_size': 1} Aug 27 03:47:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:36 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-16b2cdb2-a1a2-47c6-9557-849155a4dd0e tempest-SnapshotsActionsTest-1790596406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af" returned: 0 in 0.509s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:36 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-16b2cdb2-a1a2-47c6-9557-849155a4dd0e tempest-SnapshotsActionsTest-1790596406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:47:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-16b2cdb2-a1a2-47c6-9557-849155a4dd0e tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.c0e413cd-dd57-4ce8-8822-475328dc7bb4 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:36 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.c0e413cd-dd57-4ce8-8822-475328dc7bb4 1G Aug 27 03:47:36 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:36 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-16b2cdb2-a1a2-47c6-9557-849155a4dd0e tempest-SnapshotsActionsTest-1790596406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.c0e413cd-dd57-4ce8-8822-475328dc7bb4 1G" returned: 0 in 0.579s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-16b2cdb2-a1a2-47c6-9557-849155a4dd0e tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.c0e413cd-dd57-4ce8-8822-475328dc7bb4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:36 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.c0e413cd-dd57-4ce8-8822-475328dc7bb4 Aug 27 03:47:36 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:37 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-16b2cdb2-a1a2-47c6-9557-849155a4dd0e tempest-SnapshotsActionsTest-1790596406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.c0e413cd-dd57-4ce8-8822-475328dc7bb4" returned: 0 in 0.340s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:37 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-16b2cdb2-a1a2-47c6-9557-849155a4dd0e tempest-SnapshotsActionsTest-1790596406 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.c0e413cd-dd57-4ce8-8822-475328dc7bb4 is being set with open permissions: ugo+rw Aug 27 03:47:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-16b2cdb2-a1a2-47c6-9557-849155a4dd0e tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.c0e413cd-dd57-4ce8-8822-475328dc7bb4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:37 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.c0e413cd-dd57-4ce8-8822-475328dc7bb4 Aug 27 03:47:37 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:37 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-16b2cdb2-a1a2-47c6-9557-849155a4dd0e tempest-SnapshotsActionsTest-1790596406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.c0e413cd-dd57-4ce8-8822-475328dc7bb4" returned: 0 in 0.269s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-16b2cdb2-a1a2-47c6-9557-849155a4dd0e tempest-SnapshotsActionsTest-1790596406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.847s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.487s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-461413946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=881deef0-bf19-4644-87a8-6fae7288b01f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67396cfef02341268d674039024b88fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:47:36Z,use_quota=True,user_id='a84710da953047c7a8e2f37cac30ed5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:47:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Creating volume 881deef0-bf19-4644-87a8-6fae7288b01f {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:47:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:47:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:47:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:47:37 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:47:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-881deef0-bf19-4644-87a8-6fae7288b01f 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:37 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-881deef0-bf19-4644-87a8-6fae7288b01f 1073741824 Aug 27 03:47:37 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:37 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-16b2cdb2-a1a2-47c6-9557-849155a4dd0e tempest-SnapshotsActionsTest-1790596406 None] Create snapshot completed successfully Aug 27 03:47:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-19c1411a-062c-4ef5-b917-63a957bc9e9d tempest-SnapshotsActionsTest-478912589 None] Acquiring lock "cinder-c0e413cd-dd57-4ce8-8822-475328dc7bb4-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-19c1411a-062c-4ef5-b917-63a957bc9e9d tempest-SnapshotsActionsTest-478912589 None] Lock "cinder-c0e413cd-dd57-4ce8-8822-475328dc7bb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-19c1411a-062c-4ef5-b917-63a957bc9e9d tempest-SnapshotsActionsTest-478912589 None] Acquiring lock "cinder-quobyte-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-19c1411a-062c-4ef5-b917-63a957bc9e9d tempest-SnapshotsActionsTest-478912589 None] Lock "cinder-quobyte-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-19c1411a-062c-4ef5-b917-63a957bc9e9d tempest-SnapshotsActionsTest-478912589 None] Acquiring lock "cinder-quobyte-c0e413cd-dd57-4ce8-8822-475328dc7bb4" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-19c1411a-062c-4ef5-b917-63a957bc9e9d tempest-SnapshotsActionsTest-478912589 None] Lock "cinder-quobyte-c0e413cd-dd57-4ce8-8822-475328dc7bb4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-19c1411a-062c-4ef5-b917-63a957bc9e9d tempest-SnapshotsActionsTest-478912589 None] Deleting offline snapshot c0e413cd-dd57-4ce8-8822-475328dc7bb4 of volume de0f9c6e-93cb-4c54-8382-7fbec56a7f8d {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:47:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-19c1411a-062c-4ef5-b917-63a957bc9e9d tempest-SnapshotsActionsTest-478912589 None] snapshot_file for this snap is: volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.c0e413cd-dd57-4ce8-8822-475328dc7bb4 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:47:37 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a07c23-061a-49c4-9fd6-b2f0736157b7]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:47:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-19c1411a-062c-4ef5-b917-63a957bc9e9d tempest-SnapshotsActionsTest-478912589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.c0e413cd-dd57-4ce8-8822-475328dc7bb4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:38 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-881deef0-bf19-4644-87a8-6fae7288b01f 1073741824" returned: 0 in 0.640s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:38 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.c0e413cd-dd57-4ce8-8822-475328dc7bb4 Aug 27 03:47:38 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-881deef0-bf19-4644-87a8-6fae7288b01f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:38 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-881deef0-bf19-4644-87a8-6fae7288b01f Aug 27 03:47:38 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:38 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-19c1411a-062c-4ef5-b917-63a957bc9e9d tempest-SnapshotsActionsTest-478912589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.c0e413cd-dd57-4ce8-8822-475328dc7bb4" returned: 0 in 0.443s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:38 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-19c1411a-062c-4ef5-b917-63a957bc9e9d tempest-SnapshotsActionsTest-478912589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:47:38 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd641050-2831-418e-8583-2fc028762985]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:47:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-19c1411a-062c-4ef5-b917-63a957bc9e9d tempest-SnapshotsActionsTest-478912589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:38 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-881deef0-bf19-4644-87a8-6fae7288b01f" returned: 0 in 0.325s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:38 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:47:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:38 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93fb0419-c81b-4eef-849e-8503dc4c426a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-881deef0-bf19-4644-87a8-6fae7288b01f', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:38 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b5fd01-bbf4-4957-a099-4b63d4569f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:38 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Volume volume-881deef0-bf19-4644-87a8-6fae7288b01f (881deef0-bf19-4644-87a8-6fae7288b01f): created successfully Aug 27 03:47:38 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b5fd01-bbf4-4957-a099-4b63d4569f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:38 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Flow 'volume_create_manager' (169c9d0c-a6d8-469c-910c-85ed1717cf72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:47:38 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-3aa3fdc7-fd80-4694-ae6b-33d54e3c1739 tempest-VolumesTestJSON-1081738474 None] Created volume successfully. Aug 27 03:47:38 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af Aug 27 03:47:38 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:38 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-19c1411a-062c-4ef5-b917-63a957bc9e9d tempest-SnapshotsActionsTest-478912589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af" returned: 0 in 0.457s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:38 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-19c1411a-062c-4ef5-b917-63a957bc9e9d tempest-SnapshotsActionsTest-478912589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:47:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-19c1411a-062c-4ef5-b917-63a957bc9e9d tempest-SnapshotsActionsTest-478912589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.c0e413cd-dd57-4ce8-8822-475328dc7bb4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:38 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.c0e413cd-dd57-4ce8-8822-475328dc7bb4 Aug 27 03:47:38 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:39 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-19c1411a-062c-4ef5-b917-63a957bc9e9d tempest-SnapshotsActionsTest-478912589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.c0e413cd-dd57-4ce8-8822-475328dc7bb4" returned: 0 in 0.504s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-19c1411a-062c-4ef5-b917-63a957bc9e9d tempest-SnapshotsActionsTest-478912589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.c0e413cd-dd57-4ce8-8822-475328dc7bb4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:39 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.c0e413cd-dd57-4ce8-8822-475328dc7bb4 Aug 27 03:47:39 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:39 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-19c1411a-062c-4ef5-b917-63a957bc9e9d tempest-SnapshotsActionsTest-478912589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.c0e413cd-dd57-4ce8-8822-475328dc7bb4" returned: 0 in 0.342s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:39 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-19c1411a-062c-4ef5-b917-63a957bc9e9d tempest-SnapshotsActionsTest-478912589 None] Lock "cinder-quobyte-c0e413cd-dd57-4ce8-8822-475328dc7bb4" released by "_delete_snapshot" :: held 1.902s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:39 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-19c1411a-062c-4ef5-b917-63a957bc9e9d tempest-SnapshotsActionsTest-478912589 None] Lock "cinder-quobyte-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d" released by "delete_snapshot" :: held 1.936s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:39 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-19c1411a-062c-4ef5-b917-63a957bc9e9d tempest-SnapshotsActionsTest-478912589 None] Created reservations ['03281d4c-5df4-43b1-aa5b-5bcc30d7e5fa', 'd2d73ab1-cc53-495b-b7f7-3f58e7aaf12a', '8f6fd079-3b25-4d7e-bd45-e3a389146b66', '88e7e292-2315-4143-be52-5b9124e580d8'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:47:39 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-19c1411a-062c-4ef5-b917-63a957bc9e9d tempest-SnapshotsActionsTest-478912589 None] Delete snapshot completed successfully. Aug 27 03:47:39 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-19c1411a-062c-4ef5-b917-63a957bc9e9d tempest-SnapshotsActionsTest-478912589 None] Lock "cinder-c0e413cd-dd57-4ce8-8822-475328dc7bb4-delete_snapshot" released by "delete_snapshot" :: held 2.169s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:40 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ccc46786-2a3f-45e5-a316-350e99e69b6b tempest-VolumesTestJSON-1081738474 None] Acquiring lock "cinder-881deef0-bf19-4644-87a8-6fae7288b01f-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:40 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ccc46786-2a3f-45e5-a316-350e99e69b6b tempest-VolumesTestJSON-1081738474 None] Lock "cinder-881deef0-bf19-4644-87a8-6fae7288b01f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:40 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ccc46786-2a3f-45e5-a316-350e99e69b6b tempest-VolumesTestJSON-1081738474 None] Acquiring lock "cinder-quobyte-881deef0-bf19-4644-87a8-6fae7288b01f" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:40 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ccc46786-2a3f-45e5-a316-350e99e69b6b tempest-VolumesTestJSON-1081738474 None] Lock "cinder-quobyte-881deef0-bf19-4644-87a8-6fae7288b01f" acquired by "delete_volume" :: waited 0.025s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:40 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[017f4847-4733-4990-b94f-7b065d6432ad]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:47:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ccc46786-2a3f-45e5-a316-350e99e69b6b tempest-VolumesTestJSON-1081738474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-881deef0-bf19-4644-87a8-6fae7288b01f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:40 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-881deef0-bf19-4644-87a8-6fae7288b01f Aug 27 03:47:40 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:40 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ccc46786-2a3f-45e5-a316-350e99e69b6b tempest-VolumesTestJSON-1081738474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-881deef0-bf19-4644-87a8-6fae7288b01f" returned: 0 in 0.491s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ccc46786-2a3f-45e5-a316-350e99e69b6b tempest-VolumesTestJSON-1081738474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-881deef0-bf19-4644-87a8-6fae7288b01f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:41 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-881deef0-bf19-4644-87a8-6fae7288b01f Aug 27 03:47:41 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4eabf8a5-8cea-4d09-945c-331541b34bf6 tempest-SnapshotsActionsTest-1790596406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4eabf8a5-8cea-4d09-945c-331541b34bf6 tempest-SnapshotsActionsTest-1790596406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-4eabf8a5-8cea-4d09-945c-331541b34bf6 tempest-SnapshotsActionsTest-1790596406 None] Creating offline snapshot 1dd05d92-74ac-4bc2-86f2-5bc0441edd9b of volume de0f9c6e-93cb-4c54-8382-7fbec56a7f8d {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:47:41 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ccc46786-2a3f-45e5-a316-350e99e69b6b tempest-VolumesTestJSON-1081738474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-881deef0-bf19-4644-87a8-6fae7288b01f" returned: 0 in 0.551s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:41 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[2000ca5e-ce9e-47c3-9f8c-db8cfbf7a63a]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:47:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4eabf8a5-8cea-4d09-945c-331541b34bf6 tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ccc46786-2a3f-45e5-a316-350e99e69b6b tempest-VolumesTestJSON-1081738474 None] Lock "cinder-quobyte-881deef0-bf19-4644-87a8-6fae7288b01f" released by "delete_volume" :: held 1.124s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:41 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-ccc46786-2a3f-45e5-a316-350e99e69b6b tempest-VolumesTestJSON-1081738474 None] Created reservations ['6166ed4b-e3ab-4bd9-80af-f70446985905', '43a1eb38-7bac-4276-94eb-8efb2a755a3d', '6f855be4-b540-470c-bd03-97ab7dbad288', '8f541a74-f652-40fa-a772-09201de039ef'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:47:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ccc46786-2a3f-45e5-a316-350e99e69b6b tempest-VolumesTestJSON-1081738474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ccc46786-2a3f-45e5-a316-350e99e69b6b tempest-VolumesTestJSON-1081738474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ccc46786-2a3f-45e5-a316-350e99e69b6b tempest-VolumesTestJSON-1081738474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:47:41 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af Aug 27 03:47:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ccc46786-2a3f-45e5-a316-350e99e69b6b tempest-VolumesTestJSON-1081738474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:47:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ccc46786-2a3f-45e5-a316-350e99e69b6b tempest-VolumesTestJSON-1081738474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:41 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ccc46786-2a3f-45e5-a316-350e99e69b6b tempest-VolumesTestJSON-1081738474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:41 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:47:41 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:42 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4eabf8a5-8cea-4d09-945c-331541b34bf6 tempest-SnapshotsActionsTest-1790596406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af" returned: 0 in 0.569s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:42 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-4eabf8a5-8cea-4d09-945c-331541b34bf6 tempest-SnapshotsActionsTest-1790596406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:47:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4eabf8a5-8cea-4d09-945c-331541b34bf6 tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.1dd05d92-74ac-4bc2-86f2-5bc0441edd9b 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:42 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ccc46786-2a3f-45e5-a316-350e99e69b6b tempest-VolumesTestJSON-1081738474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.424s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:42 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-ccc46786-2a3f-45e5-a316-350e99e69b6b tempest-VolumesTestJSON-1081738474 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:47:42 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-ccc46786-2a3f-45e5-a316-350e99e69b6b tempest-VolumesTestJSON-1081738474 None] Deleted volume successfully. Aug 27 03:47:42 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.1dd05d92-74ac-4bc2-86f2-5bc0441edd9b 1G Aug 27 03:47:42 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ccc46786-2a3f-45e5-a316-350e99e69b6b tempest-VolumesTestJSON-1081738474 None] Lock "cinder-881deef0-bf19-4644-87a8-6fae7288b01f-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e0758ac8-d662-4285-8d10-3429210d1db1 tempest-VolumesTestJSON-1081738474 None] Acquiring lock "cinder-1e1247b3-828b-4b7b-96ce-974db488af05-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e0758ac8-d662-4285-8d10-3429210d1db1 tempest-VolumesTestJSON-1081738474 None] Lock "cinder-1e1247b3-828b-4b7b-96ce-974db488af05-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e0758ac8-d662-4285-8d10-3429210d1db1 tempest-VolumesTestJSON-1081738474 None] Acquiring lock "cinder-quobyte-1e1247b3-828b-4b7b-96ce-974db488af05" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e0758ac8-d662-4285-8d10-3429210d1db1 tempest-VolumesTestJSON-1081738474 None] Lock "cinder-quobyte-1e1247b3-828b-4b7b-96ce-974db488af05" acquired by "delete_volume" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:42 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16280d4-fd8a-4cbb-aa09-d20672a0d471]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:47:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e0758ac8-d662-4285-8d10-3429210d1db1 tempest-VolumesTestJSON-1081738474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-1e1247b3-828b-4b7b-96ce-974db488af05 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:42 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4eabf8a5-8cea-4d09-945c-331541b34bf6 tempest-SnapshotsActionsTest-1790596406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.1dd05d92-74ac-4bc2-86f2-5bc0441edd9b 1G" returned: 0 in 0.740s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4eabf8a5-8cea-4d09-945c-331541b34bf6 tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.1dd05d92-74ac-4bc2-86f2-5bc0441edd9b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:42 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.1dd05d92-74ac-4bc2-86f2-5bc0441edd9b Aug 27 03:47:42 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:43 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-1e1247b3-828b-4b7b-96ce-974db488af05 Aug 27 03:47:43 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:43 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4eabf8a5-8cea-4d09-945c-331541b34bf6 tempest-SnapshotsActionsTest-1790596406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.1dd05d92-74ac-4bc2-86f2-5bc0441edd9b" returned: 0 in 0.373s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:43 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-4eabf8a5-8cea-4d09-945c-331541b34bf6 tempest-SnapshotsActionsTest-1790596406 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.1dd05d92-74ac-4bc2-86f2-5bc0441edd9b is being set with open permissions: ugo+rw Aug 27 03:47:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4eabf8a5-8cea-4d09-945c-331541b34bf6 tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.1dd05d92-74ac-4bc2-86f2-5bc0441edd9b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:43 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.1dd05d92-74ac-4bc2-86f2-5bc0441edd9b Aug 27 03:47:43 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:43 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e0758ac8-d662-4285-8d10-3429210d1db1 tempest-VolumesTestJSON-1081738474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-1e1247b3-828b-4b7b-96ce-974db488af05" returned: 0 in 0.488s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e0758ac8-d662-4285-8d10-3429210d1db1 tempest-VolumesTestJSON-1081738474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-1e1247b3-828b-4b7b-96ce-974db488af05 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:43 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-1e1247b3-828b-4b7b-96ce-974db488af05 Aug 27 03:47:43 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:43 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4eabf8a5-8cea-4d09-945c-331541b34bf6 tempest-SnapshotsActionsTest-1790596406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.1dd05d92-74ac-4bc2-86f2-5bc0441edd9b" returned: 0 in 0.406s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:43 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e0758ac8-d662-4285-8d10-3429210d1db1 tempest-VolumesTestJSON-1081738474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-1e1247b3-828b-4b7b-96ce-974db488af05" returned: 0 in 0.335s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4eabf8a5-8cea-4d09-945c-331541b34bf6 tempest-SnapshotsActionsTest-1790596406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.288s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e0758ac8-d662-4285-8d10-3429210d1db1 tempest-VolumesTestJSON-1081738474 None] Lock "cinder-quobyte-1e1247b3-828b-4b7b-96ce-974db488af05" released by "delete_volume" :: held 0.937s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:43 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-4eabf8a5-8cea-4d09-945c-331541b34bf6 tempest-SnapshotsActionsTest-1790596406 None] Create snapshot completed successfully Aug 27 03:47:43 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-e0758ac8-d662-4285-8d10-3429210d1db1 tempest-VolumesTestJSON-1081738474 None] Created reservations ['23ca04d3-ab1d-4759-93bc-1593801f59bc', '203ed70e-4344-4197-bc16-5d9a77ab68f9', '609ca736-bee7-44cd-b6fd-f0329f2f1027', 'e26647ea-81a9-49c2-b3e0-081c3bdb301b'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:47:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e0758ac8-d662-4285-8d10-3429210d1db1 tempest-VolumesTestJSON-1081738474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e0758ac8-d662-4285-8d10-3429210d1db1 tempest-VolumesTestJSON-1081738474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e0758ac8-d662-4285-8d10-3429210d1db1 tempest-VolumesTestJSON-1081738474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:47:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e0758ac8-d662-4285-8d10-3429210d1db1 tempest-VolumesTestJSON-1081738474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:47:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e0758ac8-d662-4285-8d10-3429210d1db1 tempest-VolumesTestJSON-1081738474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e0758ac8-d662-4285-8d10-3429210d1db1 tempest-VolumesTestJSON-1081738474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:43 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:47:43 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:44 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e0758ac8-d662-4285-8d10-3429210d1db1 tempest-VolumesTestJSON-1081738474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.283s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:44 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-e0758ac8-d662-4285-8d10-3429210d1db1 tempest-VolumesTestJSON-1081738474 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:47:44 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e0758ac8-d662-4285-8d10-3429210d1db1 tempest-VolumesTestJSON-1081738474 None] Deleted volume successfully. Aug 27 03:47:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e0758ac8-d662-4285-8d10-3429210d1db1 tempest-VolumesTestJSON-1081738474 None] Lock "cinder-1e1247b3-828b-4b7b-96ce-974db488af05-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2142b6be-5c91-41d3-b123-95872b42f52c tempest-SnapshotsActionsTest-478912589 None] Acquiring lock "cinder-1dd05d92-74ac-4bc2-86f2-5bc0441edd9b-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2142b6be-5c91-41d3-b123-95872b42f52c tempest-SnapshotsActionsTest-478912589 None] Lock "cinder-1dd05d92-74ac-4bc2-86f2-5bc0441edd9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2142b6be-5c91-41d3-b123-95872b42f52c tempest-SnapshotsActionsTest-478912589 None] Acquiring lock "cinder-quobyte-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2142b6be-5c91-41d3-b123-95872b42f52c tempest-SnapshotsActionsTest-478912589 None] Lock "cinder-quobyte-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2142b6be-5c91-41d3-b123-95872b42f52c tempest-SnapshotsActionsTest-478912589 None] Acquiring lock "cinder-quobyte-1dd05d92-74ac-4bc2-86f2-5bc0441edd9b" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2142b6be-5c91-41d3-b123-95872b42f52c tempest-SnapshotsActionsTest-478912589 None] Lock "cinder-quobyte-1dd05d92-74ac-4bc2-86f2-5bc0441edd9b" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-2142b6be-5c91-41d3-b123-95872b42f52c tempest-SnapshotsActionsTest-478912589 None] Deleting offline snapshot 1dd05d92-74ac-4bc2-86f2-5bc0441edd9b of volume de0f9c6e-93cb-4c54-8382-7fbec56a7f8d {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:47:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-2142b6be-5c91-41d3-b123-95872b42f52c tempest-SnapshotsActionsTest-478912589 None] snapshot_file for this snap is: volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.1dd05d92-74ac-4bc2-86f2-5bc0441edd9b {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:47:44 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a69420-a2a5-4f10-a1ac-188288e84a4f]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:47:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2142b6be-5c91-41d3-b123-95872b42f52c tempest-SnapshotsActionsTest-478912589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.1dd05d92-74ac-4bc2-86f2-5bc0441edd9b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-710725e9-b089-432c-b09e-e93c1da5d035 tempest-VolumesTestJSON-1081738474 None] Acquiring lock "cinder-f5c55062-92a3-4115-bcfb-849607f508c7-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-710725e9-b089-432c-b09e-e93c1da5d035 tempest-VolumesTestJSON-1081738474 None] Lock "cinder-f5c55062-92a3-4115-bcfb-849607f508c7-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:45 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.1dd05d92-74ac-4bc2-86f2-5bc0441edd9b Aug 27 03:47:45 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-710725e9-b089-432c-b09e-e93c1da5d035 tempest-VolumesTestJSON-1081738474 None] Acquiring lock "cinder-quobyte-f5c55062-92a3-4115-bcfb-849607f508c7" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-710725e9-b089-432c-b09e-e93c1da5d035 tempest-VolumesTestJSON-1081738474 None] Lock "cinder-quobyte-f5c55062-92a3-4115-bcfb-849607f508c7" acquired by "delete_volume" :: waited 0.025s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:45 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5839aa-1708-43e5-a0dc-56e9402f03e0]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:47:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-710725e9-b089-432c-b09e-e93c1da5d035 tempest-VolumesTestJSON-1081738474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5c55062-92a3-4115-bcfb-849607f508c7 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:45 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5c55062-92a3-4115-bcfb-849607f508c7 Aug 27 03:47:45 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:45 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2142b6be-5c91-41d3-b123-95872b42f52c tempest-SnapshotsActionsTest-478912589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.1dd05d92-74ac-4bc2-86f2-5bc0441edd9b" returned: 0 in 0.474s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:45 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-2142b6be-5c91-41d3-b123-95872b42f52c tempest-SnapshotsActionsTest-478912589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:47:45 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[9426276f-543b-4c9d-bd92-a27a80a331be]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:47:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2142b6be-5c91-41d3-b123-95872b42f52c tempest-SnapshotsActionsTest-478912589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:45 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af Aug 27 03:47:45 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:45 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-710725e9-b089-432c-b09e-e93c1da5d035 tempest-VolumesTestJSON-1081738474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5c55062-92a3-4115-bcfb-849607f508c7" returned: 0 in 0.491s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-710725e9-b089-432c-b09e-e93c1da5d035 tempest-VolumesTestJSON-1081738474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5c55062-92a3-4115-bcfb-849607f508c7 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:45 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5c55062-92a3-4115-bcfb-849607f508c7 Aug 27 03:47:45 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:46 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2142b6be-5c91-41d3-b123-95872b42f52c tempest-SnapshotsActionsTest-478912589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af" returned: 0 in 0.574s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:46 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-2142b6be-5c91-41d3-b123-95872b42f52c tempest-SnapshotsActionsTest-478912589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:47:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2142b6be-5c91-41d3-b123-95872b42f52c tempest-SnapshotsActionsTest-478912589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.1dd05d92-74ac-4bc2-86f2-5bc0441edd9b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:46 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.1dd05d92-74ac-4bc2-86f2-5bc0441edd9b Aug 27 03:47:46 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:46 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-710725e9-b089-432c-b09e-e93c1da5d035 tempest-VolumesTestJSON-1081738474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f5c55062-92a3-4115-bcfb-849607f508c7" returned: 0 in 0.392s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:46 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-710725e9-b089-432c-b09e-e93c1da5d035 tempest-VolumesTestJSON-1081738474 None] Lock "cinder-quobyte-f5c55062-92a3-4115-bcfb-849607f508c7" released by "delete_volume" :: held 0.952s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:46 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-710725e9-b089-432c-b09e-e93c1da5d035 tempest-VolumesTestJSON-1081738474 None] Created reservations ['f4e924f4-5fb4-4ac3-a4b6-629babf44745', '2d5183e9-bebd-4e28-9cd4-0921de8d7316', 'b8e98f8f-b06d-4793-bad7-4fd53f7f9e37', '80a48894-08ab-466c-84d3-83aa7fb2d755'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:47:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-710725e9-b089-432c-b09e-e93c1da5d035 tempest-VolumesTestJSON-1081738474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-710725e9-b089-432c-b09e-e93c1da5d035 tempest-VolumesTestJSON-1081738474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:46 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-710725e9-b089-432c-b09e-e93c1da5d035 tempest-VolumesTestJSON-1081738474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:47:46 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-710725e9-b089-432c-b09e-e93c1da5d035 tempest-VolumesTestJSON-1081738474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:47:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-710725e9-b089-432c-b09e-e93c1da5d035 tempest-VolumesTestJSON-1081738474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-710725e9-b089-432c-b09e-e93c1da5d035 tempest-VolumesTestJSON-1081738474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:46 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:47:46 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:46 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2142b6be-5c91-41d3-b123-95872b42f52c tempest-SnapshotsActionsTest-478912589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.1dd05d92-74ac-4bc2-86f2-5bc0441edd9b" returned: 0 in 0.603s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2142b6be-5c91-41d3-b123-95872b42f52c tempest-SnapshotsActionsTest-478912589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.1dd05d92-74ac-4bc2-86f2-5bc0441edd9b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:46 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.1dd05d92-74ac-4bc2-86f2-5bc0441edd9b Aug 27 03:47:46 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:46 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-710725e9-b089-432c-b09e-e93c1da5d035 tempest-VolumesTestJSON-1081738474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.393s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:46 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-710725e9-b089-432c-b09e-e93c1da5d035 tempest-VolumesTestJSON-1081738474 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:47:46 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-710725e9-b089-432c-b09e-e93c1da5d035 tempest-VolumesTestJSON-1081738474 None] Deleted volume successfully. Aug 27 03:47:46 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-710725e9-b089-432c-b09e-e93c1da5d035 tempest-VolumesTestJSON-1081738474 None] Lock "cinder-f5c55062-92a3-4115-bcfb-849607f508c7-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:46 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2142b6be-5c91-41d3-b123-95872b42f52c tempest-SnapshotsActionsTest-478912589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.1dd05d92-74ac-4bc2-86f2-5bc0441edd9b" returned: 0 in 0.298s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:46 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2142b6be-5c91-41d3-b123-95872b42f52c tempest-SnapshotsActionsTest-478912589 None] Lock "cinder-quobyte-1dd05d92-74ac-4bc2-86f2-5bc0441edd9b" released by "_delete_snapshot" :: held 2.105s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:46 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2142b6be-5c91-41d3-b123-95872b42f52c tempest-SnapshotsActionsTest-478912589 None] Lock "cinder-quobyte-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d" released by "delete_snapshot" :: held 2.165s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:47 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-2142b6be-5c91-41d3-b123-95872b42f52c tempest-SnapshotsActionsTest-478912589 None] Created reservations ['fb02b58e-ed63-4953-b4f8-70d6256b09ce', '544fd76c-a0dd-402c-bd46-28ed942f89e8', '61decefc-3aa8-4521-8b06-efec01e1bc93', '3732d769-62a7-475b-9f7c-e863e17b76f9'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:47:47 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-2142b6be-5c91-41d3-b123-95872b42f52c tempest-SnapshotsActionsTest-478912589 None] Delete snapshot completed successfully. Aug 27 03:47:47 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2142b6be-5c91-41d3-b123-95872b42f52c tempest-SnapshotsActionsTest-478912589 None] Lock "cinder-1dd05d92-74ac-4bc2-86f2-5bc0441edd9b-delete_snapshot" released by "delete_snapshot" :: held 2.349s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-61ca9f76-4d2e-4d5f-ac9a-89d9770f10e1 tempest-SnapshotsActionsTest-1790596406 None] Acquiring lock "cinder-9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-61ca9f76-4d2e-4d5f-ac9a-89d9770f10e1 tempest-SnapshotsActionsTest-1790596406 None] Lock "cinder-9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-61ca9f76-4d2e-4d5f-ac9a-89d9770f10e1 tempest-SnapshotsActionsTest-1790596406 None] Acquiring lock "cinder-quobyte-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-61ca9f76-4d2e-4d5f-ac9a-89d9770f10e1 tempest-SnapshotsActionsTest-1790596406 None] Lock "cinder-quobyte-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-61ca9f76-4d2e-4d5f-ac9a-89d9770f10e1 tempest-SnapshotsActionsTest-1790596406 None] Acquiring lock "cinder-quobyte-9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-61ca9f76-4d2e-4d5f-ac9a-89d9770f10e1 tempest-SnapshotsActionsTest-1790596406 None] Lock "cinder-quobyte-9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-61ca9f76-4d2e-4d5f-ac9a-89d9770f10e1 tempest-SnapshotsActionsTest-1790596406 None] Deleting offline snapshot 9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af of volume de0f9c6e-93cb-4c54-8382-7fbec56a7f8d {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:47:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-61ca9f76-4d2e-4d5f-ac9a-89d9770f10e1 tempest-SnapshotsActionsTest-1790596406 None] snapshot_file for this snap is: volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:47:48 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[6201fc57-f5de-403e-b20c-9dc042640ef0]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:47:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-61ca9f76-4d2e-4d5f-ac9a-89d9770f10e1 tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:48 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af Aug 27 03:47:48 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:49 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-61ca9f76-4d2e-4d5f-ac9a-89d9770f10e1 tempest-SnapshotsActionsTest-1790596406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af" returned: 0 in 0.414s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:49 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-61ca9f76-4d2e-4d5f-ac9a-89d9770f10e1 tempest-SnapshotsActionsTest-1790596406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:47:49 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[471b3e8e-ed53-45df-96de-f00c7fe67e85]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:47:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-61ca9f76-4d2e-4d5f-ac9a-89d9770f10e1 tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:49 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d Aug 27 03:47:49 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:49 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-61ca9f76-4d2e-4d5f-ac9a-89d9770f10e1 tempest-SnapshotsActionsTest-1790596406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d" returned: 0 in 0.401s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-61ca9f76-4d2e-4d5f-ac9a-89d9770f10e1 tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:49 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af Aug 27 03:47:49 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:49 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-61ca9f76-4d2e-4d5f-ac9a-89d9770f10e1 tempest-SnapshotsActionsTest-1790596406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af" returned: 0 in 0.430s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-61ca9f76-4d2e-4d5f-ac9a-89d9770f10e1 tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:49 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af Aug 27 03:47:49 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:50 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-61ca9f76-4d2e-4d5f-ac9a-89d9770f10e1 tempest-SnapshotsActionsTest-1790596406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d.9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af" returned: 0 in 0.291s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-61ca9f76-4d2e-4d5f-ac9a-89d9770f10e1 tempest-SnapshotsActionsTest-1790596406 None] Lock "cinder-quobyte-9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af" released by "_delete_snapshot" :: held 1.662s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-61ca9f76-4d2e-4d5f-ac9a-89d9770f10e1 tempest-SnapshotsActionsTest-1790596406 None] Lock "cinder-quobyte-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d" released by "delete_snapshot" :: held 1.694s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:50 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-61ca9f76-4d2e-4d5f-ac9a-89d9770f10e1 tempest-SnapshotsActionsTest-1790596406 None] Created reservations ['9c0b3914-cd95-4a20-a926-e357b58df18f', '21aed575-f5c8-421b-9940-060e599a55cb', 'fa31cd12-c9b5-4139-ad8e-ca8192b33417', '2041e9bb-86cf-4c5b-9322-7fa802a1af34'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:47:50 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-61ca9f76-4d2e-4d5f-ac9a-89d9770f10e1 tempest-SnapshotsActionsTest-1790596406 None] Delete snapshot completed successfully. Aug 27 03:47:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-61ca9f76-4d2e-4d5f-ac9a-89d9770f10e1 tempest-SnapshotsActionsTest-1790596406 None] Lock "cinder-9bdc4ac9-bed8-4cfd-a6aa-3f6c547712af-delete_snapshot" released by "delete_snapshot" :: held 1.904s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5a318aa4-06cc-4651-b866-a3ad6c58cc19 tempest-SnapshotsActionsTest-1790596406 None] Acquiring lock "cinder-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5a318aa4-06cc-4651-b866-a3ad6c58cc19 tempest-SnapshotsActionsTest-1790596406 None] Lock "cinder-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5a318aa4-06cc-4651-b866-a3ad6c58cc19 tempest-SnapshotsActionsTest-1790596406 None] Acquiring lock "cinder-quobyte-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:47:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5a318aa4-06cc-4651-b866-a3ad6c58cc19 tempest-SnapshotsActionsTest-1790596406 None] Lock "cinder-quobyte-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d" acquired by "delete_volume" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:47:51 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e62414-98b1-44fb-b77b-a8ac3c0db93d]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:47:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5a318aa4-06cc-4651-b866-a3ad6c58cc19 tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:51 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d Aug 27 03:47:51 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:51 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5a318aa4-06cc-4651-b866-a3ad6c58cc19 tempest-SnapshotsActionsTest-1790596406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d" returned: 0 in 0.533s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5a318aa4-06cc-4651-b866-a3ad6c58cc19 tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:51 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d Aug 27 03:47:51 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:52 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5a318aa4-06cc-4651-b866-a3ad6c58cc19 tempest-SnapshotsActionsTest-1790596406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d" returned: 0 in 0.392s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:52 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5a318aa4-06cc-4651-b866-a3ad6c58cc19 tempest-SnapshotsActionsTest-1790596406 None] Lock "cinder-quobyte-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d" released by "delete_volume" :: held 1.022s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:52 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-5a318aa4-06cc-4651-b866-a3ad6c58cc19 tempest-SnapshotsActionsTest-1790596406 None] Created reservations ['f2ebc69e-a63d-4c42-9593-8110e64b5ec1', '8a821cfa-dd8d-4214-8641-1cee965383b2', 'a4714097-19d7-40ed-a2c2-f978c1264c40', 'dfef0e95-ccd2-4845-ac8c-5cb8a3f67931'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:47:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5a318aa4-06cc-4651-b866-a3ad6c58cc19 tempest-SnapshotsActionsTest-1790596406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5a318aa4-06cc-4651-b866-a3ad6c58cc19 tempest-SnapshotsActionsTest-1790596406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5a318aa4-06cc-4651-b866-a3ad6c58cc19 tempest-SnapshotsActionsTest-1790596406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:47:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5a318aa4-06cc-4651-b866-a3ad6c58cc19 tempest-SnapshotsActionsTest-1790596406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:47:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5a318aa4-06cc-4651-b866-a3ad6c58cc19 tempest-SnapshotsActionsTest-1790596406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5a318aa4-06cc-4651-b866-a3ad6c58cc19 tempest-SnapshotsActionsTest-1790596406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:52 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:47:52 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:52 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5a318aa4-06cc-4651-b866-a3ad6c58cc19 tempest-SnapshotsActionsTest-1790596406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.313s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:52 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-5a318aa4-06cc-4651-b866-a3ad6c58cc19 tempest-SnapshotsActionsTest-1790596406 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:47:52 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-5a318aa4-06cc-4651-b866-a3ad6c58cc19 tempest-SnapshotsActionsTest-1790596406 None] Deleted volume successfully. Aug 27 03:47:52 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5a318aa4-06cc-4651-b866-a3ad6c58cc19 tempest-SnapshotsActionsTest-1790596406 None] Lock "cinder-de0f9c6e-93cb-4c54-8382-7fbec56a7f8d-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:47:53 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:47:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Flow 'volume_create_manager' (5cb4c969-c7ea-4071-b28e-8b2f05e7826f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:47:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cae4c3c-6203-4b6c-b3c3-63e849c8e2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cae4c3c-6203-4b6c-b3c3-63e849c8e2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-572501998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee42fb02-6dfc-46bf-a43c-5addb128c5a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac131be2ec01424daa9cac6311c98d03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:47:54Z,use_quota=True,user_id='2c6f9ff434c04c5196aa7827c8e6748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (656f19d4-bdb3-4c41-873e-9089cf213648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (656f19d4-bdb3-4c41-873e-9089cf213648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70280dec-8524-4aa4-b028-e7c7028fb94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70280dec-8524-4aa4-b028-e7c7028fb94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee42fb02-6dfc-46bf-a43c-5addb128c5a0', 'volume_name': 'volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46fc7ce4-0aac-469d-81ab-d493f5f3dee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46fc7ce4-0aac-469d-81ab-d493f5f3dee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f2522b-db69-4dca-876e-b9db8934c554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:53 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Volume ee42fb02-6dfc-46bf-a43c-5addb128c5a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0', 'volume_size': 1} Aug 27 03:47:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-572501998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee42fb02-6dfc-46bf-a43c-5addb128c5a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac131be2ec01424daa9cac6311c98d03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:47:54Z,use_quota=True,user_id='2c6f9ff434c04c5196aa7827c8e6748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:47:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Creating volume ee42fb02-6dfc-46bf-a43c-5addb128c5a0 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:47:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:47:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:47:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:47:53 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:47:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:53 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0 1073741824 Aug 27 03:47:53 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:53 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-541ac627-a1c8-4bd9-9b9f-0e863d57888e tempest-GroupsTest-755820279 None] Group tempest-Group1-286384693: creating Aug 27 03:47:53 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-541ac627-a1c8-4bd9-9b9f-0e863d57888e tempest-GroupsTest-755820279 None] Group tempest-Group1-286384693: created successfully Aug 27 03:47:53 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-541ac627-a1c8-4bd9-9b9f-0e863d57888e tempest-GroupsTest-755820279 None] Create group completed successfully. Aug 27 03:47:54 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0 1073741824" returned: 0 in 0.629s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:54 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0 Aug 27 03:47:54 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:54 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0" returned: 0 in 0.416s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:54 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:47:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f2522b-db69-4dca-876e-b9db8934c554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (470e4c50-7a5f-4ac1-9dd9-b09f8a6db088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:55 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Volume volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0 (ee42fb02-6dfc-46bf-a43c-5addb128c5a0): created successfully Aug 27 03:47:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (470e4c50-7a5f-4ac1-9dd9-b09f8a6db088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Flow 'volume_create_manager' (5cb4c969-c7ea-4071-b28e-8b2f05e7826f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:47:55 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-66f7b34b-0e38-481a-a183-f92a1610b08c tempest-TestStampPattern-1729760105 None] Created volume successfully. Aug 27 03:47:55 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-318275eb-7c86-4979-b9a7-85b80007bed0 tempest-GroupsTest-755820279 None] Group tempest-Group2-611663816: creating Aug 27 03:47:55 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-318275eb-7c86-4979-b9a7-85b80007bed0 tempest-GroupsTest-755820279 None] Group tempest-Group2-611663816: created successfully Aug 27 03:47:55 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-318275eb-7c86-4979-b9a7-85b80007bed0 tempest-GroupsTest-755820279 None] Create group completed successfully. Aug 27 03:47:57 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:47:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Flow 'volume_create_manager' (ba94a630-2a41-4adc-bec8-ac2b5b41a607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:47:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9669d4-1388-40d5-a00a-d6eacee26b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9669d4-1388-40d5-a00a-d6eacee26b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-323604834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2027546c-5fc5-4d1b-9204-fb4d750461e5,host='devstack@QuobyteHD#QuobyteHD',id=37374dd3-5f47-48b5-9284-484ab4c6fcf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b242e045314eac8bcbf7dc32c878d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:47:57Z,use_quota=True,user_id='169433aa03be45eaaae880dd4318a08f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82da5c3c-9b94-442f-9b72-e8c58c8ab5e5),volume_type_id=82da5c3c-9b94-442f-9b72-e8c58c8ab5e5)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e083aa-0a5e-40b5-9927-27d1538a6b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e083aa-0a5e-40b5-9927-27d1538a6b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51309001-72e6-4e9e-94dc-94411df4ad20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51309001-72e6-4e9e-94dc-94411df4ad20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37374dd3-5f47-48b5-9284-484ab4c6fcf8', 'volume_name': 'volume-37374dd3-5f47-48b5-9284-484ab4c6fcf8', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b04e8c7-c888-4647-9277-be4a2dfde6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b04e8c7-c888-4647-9277-be4a2dfde6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc556e53-ab56-4fa2-8930-7e1b2845901c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:57 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Volume 37374dd3-5f47-48b5-9284-484ab4c6fcf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37374dd3-5f47-48b5-9284-484ab4c6fcf8', 'volume_size': 1} Aug 27 03:47:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2027546c-5fc5-4d1b-9204-fb4d750461e5,created_at=2026-08-27T01:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-323604834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2027546c-5fc5-4d1b-9204-fb4d750461e5,host='devstack@QuobyteHD#QuobyteHD',id=37374dd3-5f47-48b5-9284-484ab4c6fcf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b242e045314eac8bcbf7dc32c878d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:47:57Z,use_quota=True,user_id='169433aa03be45eaaae880dd4318a08f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82da5c3c-9b94-442f-9b72-e8c58c8ab5e5),volume_type_id=82da5c3c-9b94-442f-9b72-e8c58c8ab5e5)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:47:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Creating volume 37374dd3-5f47-48b5-9284-484ab4c6fcf8 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:47:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:47:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:47:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:47:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:47:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:47:57 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:47:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-37374dd3-5f47-48b5-9284-484ab4c6fcf8 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:57 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-37374dd3-5f47-48b5-9284-484ab4c6fcf8 1073741824 Aug 27 03:47:57 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:57 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-37374dd3-5f47-48b5-9284-484ab4c6fcf8 1073741824" returned: 0 in 0.631s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-37374dd3-5f47-48b5-9284-484ab4c6fcf8 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:47:58 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-37374dd3-5f47-48b5-9284-484ab4c6fcf8 Aug 27 03:47:58 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:47:58 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Aug 27 03:47:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-37374dd3-5f47-48b5-9284-484ab4c6fcf8" returned: 0 in 0.396s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:47:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:47:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:47:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc556e53-ab56-4fa2-8930-7e1b2845901c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37374dd3-5f47-48b5-9284-484ab4c6fcf8', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55fb5bc0-cbcb-4ef8-af7a-2242c0f1bc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:47:58 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Volume volume-37374dd3-5f47-48b5-9284-484ab4c6fcf8 (37374dd3-5f47-48b5-9284-484ab4c6fcf8): created successfully Aug 27 03:47:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55fb5bc0-cbcb-4ef8-af7a-2242c0f1bc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:47:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Flow 'volume_create_manager' (ba94a630-2a41-4adc-bec8-ac2b5b41a607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:47:58 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-5e6be989-43a3-4c4c-a108-f693b6ba0fdc tempest-GroupsTest-755820279 None] Created volume successfully. Aug 27 03:48:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9acf6a17-14bb-4251-a9d0-1f8e67bc94c8 tempest-GroupsTest-755820279 None] Acquiring lock "cinder-quobyte-37374dd3-5f47-48b5-9284-484ab4c6fcf8" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:48:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9acf6a17-14bb-4251-a9d0-1f8e67bc94c8 tempest-GroupsTest-755820279 None] Lock "cinder-quobyte-37374dd3-5f47-48b5-9284-484ab4c6fcf8" acquired by "delete_volume" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:48:00 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10b4a55-09c9-4bdc-b539-cd1aee109f0b]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:48:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9acf6a17-14bb-4251-a9d0-1f8e67bc94c8 tempest-GroupsTest-755820279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-37374dd3-5f47-48b5-9284-484ab4c6fcf8 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:00 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-37374dd3-5f47-48b5-9284-484ab4c6fcf8 Aug 27 03:48:00 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:01 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9acf6a17-14bb-4251-a9d0-1f8e67bc94c8 tempest-GroupsTest-755820279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-37374dd3-5f47-48b5-9284-484ab4c6fcf8" returned: 0 in 0.464s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9acf6a17-14bb-4251-a9d0-1f8e67bc94c8 tempest-GroupsTest-755820279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-37374dd3-5f47-48b5-9284-484ab4c6fcf8 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:01 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-37374dd3-5f47-48b5-9284-484ab4c6fcf8 Aug 27 03:48:01 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:01 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9acf6a17-14bb-4251-a9d0-1f8e67bc94c8 tempest-GroupsTest-755820279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-37374dd3-5f47-48b5-9284-484ab4c6fcf8" returned: 0 in 0.341s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:01 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9acf6a17-14bb-4251-a9d0-1f8e67bc94c8 tempest-GroupsTest-755820279 None] Lock "cinder-quobyte-37374dd3-5f47-48b5-9284-484ab4c6fcf8" released by "delete_volume" :: held 0.888s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:48:01 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-9acf6a17-14bb-4251-a9d0-1f8e67bc94c8 tempest-GroupsTest-755820279 None] Created reservations ['c306f217-387b-4ea3-abba-9914dd4ac4ee'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:48:01 devstack cinder-volume[94328]: WARNING cinder.quota [None req-9acf6a17-14bb-4251-a9d0-1f8e67bc94c8 tempest-GroupsTest-755820279 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-116521929 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-116521929, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:48:01 devstack cinder-volume[94328]: WARNING cinder.quota [None req-9acf6a17-14bb-4251-a9d0-1f8e67bc94c8 tempest-GroupsTest-755820279 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-116521929 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-116521929, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:48:01 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-9acf6a17-14bb-4251-a9d0-1f8e67bc94c8 tempest-GroupsTest-755820279 None] Created reservations ['f16d0522-c6cb-407c-8fc2-f0aa3d46cd0f', '8401df47-dc60-4504-a92d-c28b5e459e58', 'f57c6844-1fb9-4e37-962f-4f7d08076711', '09c281ec-cc14-4c18-b5d6-a1a79b30b376'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:48:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9acf6a17-14bb-4251-a9d0-1f8e67bc94c8 tempest-GroupsTest-755820279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9acf6a17-14bb-4251-a9d0-1f8e67bc94c8 tempest-GroupsTest-755820279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-9acf6a17-14bb-4251-a9d0-1f8e67bc94c8 tempest-GroupsTest-755820279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-9acf6a17-14bb-4251-a9d0-1f8e67bc94c8 tempest-GroupsTest-755820279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9acf6a17-14bb-4251-a9d0-1f8e67bc94c8 tempest-GroupsTest-755820279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9acf6a17-14bb-4251-a9d0-1f8e67bc94c8 tempest-GroupsTest-755820279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:01 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:48:01 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:02 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-752fa761-90b2-4e12-8cd3-f00f83a66180 tempest-GroupsTest-755820279 None] Created reservations ['948b81e2-13d3-4eeb-aac7-bd8e5f062a04'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:48:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-752fa761-90b2-4e12-8cd3-f00f83a66180 tempest-GroupsTest-755820279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-752fa761-90b2-4e12-8cd3-f00f83a66180 tempest-GroupsTest-755820279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:02 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-752fa761-90b2-4e12-8cd3-f00f83a66180 tempest-GroupsTest-755820279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:02 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-752fa761-90b2-4e12-8cd3-f00f83a66180 tempest-GroupsTest-755820279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-752fa761-90b2-4e12-8cd3-f00f83a66180 tempest-GroupsTest-755820279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-752fa761-90b2-4e12-8cd3-f00f83a66180 tempest-GroupsTest-755820279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:02 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:48:02 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:02 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9acf6a17-14bb-4251-a9d0-1f8e67bc94c8 tempest-GroupsTest-755820279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.675s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:02 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-9acf6a17-14bb-4251-a9d0-1f8e67bc94c8 tempest-GroupsTest-755820279 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:48:02 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-9acf6a17-14bb-4251-a9d0-1f8e67bc94c8 tempest-GroupsTest-755820279 None] Delete group completed successfully. Aug 27 03:48:02 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-752fa761-90b2-4e12-8cd3-f00f83a66180 tempest-GroupsTest-755820279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.527s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:02 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-752fa761-90b2-4e12-8cd3-f00f83a66180 tempest-GroupsTest-755820279 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:48:03 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-752fa761-90b2-4e12-8cd3-f00f83a66180 tempest-GroupsTest-755820279 None] Delete group completed successfully. Aug 27 03:48:04 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-42a61ea4-1fce-486c-8940-c7a63de7a373 tempest-GroupsTest-755820279 None] Group tempest-GroupsTest-Group-1240621208: creating Aug 27 03:48:04 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-42a61ea4-1fce-486c-8940-c7a63de7a373 tempest-GroupsTest-755820279 None] Group tempest-GroupsTest-Group-1240621208: created successfully Aug 27 03:48:04 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-42a61ea4-1fce-486c-8940-c7a63de7a373 tempest-GroupsTest-755820279 None] Create group completed successfully. Aug 27 03:48:04 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:48:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Flow 'volume_create_manager' (ffcf6fc9-6efd-4490-8570-7fa51089a8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:48:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c4ec969-627d-42d6-81f5-2b1648009e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c4ec969-627d-42d6-81f5-2b1648009e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1415245521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc77bb1f-bc7e-465d-8344-db3d78053ace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9040aff16c9429da899fe761e3f8373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:48:05Z,use_quota=True,user_id='ec89f954a5fc406ab85ddaed496483ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bab56e39-6883-4869-b780-b6c9b0cd34f2),volume_type_id=bab56e39-6883-4869-b780-b6c9b0cd34f2)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (856d9f6d-1e2a-4811-ba47-e69291001b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (856d9f6d-1e2a-4811-ba47-e69291001b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed113294-e6ba-4307-bb5e-a22b42bb9e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed113294-e6ba-4307-bb5e-a22b42bb9e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc77bb1f-bc7e-465d-8344-db3d78053ace', 'volume_name': 'volume-bc77bb1f-bc7e-465d-8344-db3d78053ace', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161f66a3-d351-4793-b0fc-7f9a97f302c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161f66a3-d351-4793-b0fc-7f9a97f302c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (406e5e45-cc6a-4579-a162-d233c15c217e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:04 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Volume bc77bb1f-bc7e-465d-8344-db3d78053ace: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc77bb1f-bc7e-465d-8344-db3d78053ace', 'volume_size': 1} Aug 27 03:48:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:04 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1415245521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc77bb1f-bc7e-465d-8344-db3d78053ace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9040aff16c9429da899fe761e3f8373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:48:05Z,use_quota=True,user_id='ec89f954a5fc406ab85ddaed496483ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bab56e39-6883-4869-b780-b6c9b0cd34f2),volume_type_id=bab56e39-6883-4869-b780-b6c9b0cd34f2)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:48:04 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Creating volume bc77bb1f-bc7e-465d-8344-db3d78053ace {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:48:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:04 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:04 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:04 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:48:04 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:48:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc77bb1f-bc7e-465d-8344-db3d78053ace 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:04 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc77bb1f-bc7e-465d-8344-db3d78053ace 1073741824 Aug 27 03:48:04 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:05 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc77bb1f-bc7e-465d-8344-db3d78053ace 1073741824" returned: 0 in 0.690s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc77bb1f-bc7e-465d-8344-db3d78053ace {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:05 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc77bb1f-bc7e-465d-8344-db3d78053ace Aug 27 03:48:05 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:06 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc77bb1f-bc7e-465d-8344-db3d78053ace" returned: 0 in 0.627s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (406e5e45-cc6a-4579-a162-d233c15c217e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc77bb1f-bc7e-465d-8344-db3d78053ace', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366d84b6-58cd-47b7-8291-bca1243d07fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:06 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Volume volume-bc77bb1f-bc7e-465d-8344-db3d78053ace (bc77bb1f-bc7e-465d-8344-db3d78053ace): created successfully Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366d84b6-58cd-47b7-8291-bca1243d07fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Flow 'volume_create_manager' (ffcf6fc9-6efd-4490-8570-7fa51089a8ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:48:06 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-bb3a7e48-52d6-4f87-824b-ad97f06cfe09 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Created volume successfully. Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Flow 'volume_create_manager' (5e5dbc8f-4b52-4753-9d5c-8ce8e1b8f5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd899559-a539-4a94-8136-efb056dceb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd899559-a539-4a94-8136-efb056dceb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1821509942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=264ef56b-9a50-4b2a-93ba-b46d607b7749,host='devstack@QuobyteHD#QuobyteHD',id=5e30b3e6-d452-4185-a64e-26e4a0d97dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b242e045314eac8bcbf7dc32c878d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:48:06Z,use_quota=True,user_id='169433aa03be45eaaae880dd4318a08f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fe5d68b-c9f3-46f3-84e3-07e66716e62e),volume_type_id=9fe5d68b-c9f3-46f3-84e3-07e66716e62e)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a2b2e3-b54f-46e3-b68c-9cd050428d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a2b2e3-b54f-46e3-b68c-9cd050428d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231c00d6-f590-44f7-ac54-c8df49e9aeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231c00d6-f590-44f7-ac54-c8df49e9aeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e30b3e6-d452-4185-a64e-26e4a0d97dc5', 'volume_name': 'volume-5e30b3e6-d452-4185-a64e-26e4a0d97dc5', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17389952-d3c4-4621-a3d4-1df7a1d1b04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17389952-d3c4-4621-a3d4-1df7a1d1b04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2b43f2-3e85-4355-bd3b-25e84ba24448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:06 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Volume 5e30b3e6-d452-4185-a64e-26e4a0d97dc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e30b3e6-d452-4185-a64e-26e4a0d97dc5', 'volume_size': 1} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=264ef56b-9a50-4b2a-93ba-b46d607b7749,created_at=2026-08-27T01:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1821509942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=264ef56b-9a50-4b2a-93ba-b46d607b7749,host='devstack@QuobyteHD#QuobyteHD',id=5e30b3e6-d452-4185-a64e-26e4a0d97dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b242e045314eac8bcbf7dc32c878d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:48:06Z,use_quota=True,user_id='169433aa03be45eaaae880dd4318a08f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fe5d68b-c9f3-46f3-84e3-07e66716e62e),volume_type_id=9fe5d68b-c9f3-46f3-84e3-07e66716e62e)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Creating volume 5e30b3e6-d452-4185-a64e-26e4a0d97dc5 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:48:06 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:48:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e30b3e6-d452-4185-a64e-26e4a0d97dc5 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:06 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e30b3e6-d452-4185-a64e-26e4a0d97dc5 1073741824 Aug 27 03:48:06 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:07 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e30b3e6-d452-4185-a64e-26e4a0d97dc5 1073741824" returned: 0 in 0.646s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e30b3e6-d452-4185-a64e-26e4a0d97dc5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:07 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e30b3e6-d452-4185-a64e-26e4a0d97dc5 Aug 27 03:48:07 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9c4c45ad-d00a-4a39-baf1-1acd5cc74f42 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9c4c45ad-d00a-4a39-baf1-1acd5cc74f42 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-9c4c45ad-d00a-4a39-baf1-1acd5cc74f42 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-9c4c45ad-d00a-4a39-baf1-1acd5cc74f42 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9c4c45ad-d00a-4a39-baf1-1acd5cc74f42 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9c4c45ad-d00a-4a39-baf1-1acd5cc74f42 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:07 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:48:07 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:07 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e30b3e6-d452-4185-a64e-26e4a0d97dc5" returned: 0 in 0.635s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:48:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2b43f2-3e85-4355-bd3b-25e84ba24448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e30b3e6-d452-4185-a64e-26e4a0d97dc5', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (145cc032-eacb-485a-9020-5c201bcedacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:08 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Volume volume-5e30b3e6-d452-4185-a64e-26e4a0d97dc5 (5e30b3e6-d452-4185-a64e-26e4a0d97dc5): created successfully Aug 27 03:48:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (145cc032-eacb-485a-9020-5c201bcedacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Flow 'volume_create_manager' (5e5dbc8f-4b52-4753-9d5c-8ce8e1b8f5f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:48:08 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-29b5c2cc-1161-482a-909f-56a3b5bca404 tempest-GroupsTest-755820279 None] Created volume successfully. Aug 27 03:48:08 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9c4c45ad-d00a-4a39-baf1-1acd5cc74f42 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.568s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:08 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-9c4c45ad-d00a-4a39-baf1-1acd5cc74f42 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:48:08 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-9c4c45ad-d00a-4a39-baf1-1acd5cc74f42 tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Retype volume completed successfully. Aug 27 03:48:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e3763c95-5c87-452e-9aac-3b93f64c2a5f tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Acquiring lock "cinder-bc77bb1f-bc7e-465d-8344-db3d78053ace-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:48:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e3763c95-5c87-452e-9aac-3b93f64c2a5f tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Lock "cinder-bc77bb1f-bc7e-465d-8344-db3d78053ace-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:48:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e3763c95-5c87-452e-9aac-3b93f64c2a5f tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Acquiring lock "cinder-quobyte-bc77bb1f-bc7e-465d-8344-db3d78053ace" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:48:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e3763c95-5c87-452e-9aac-3b93f64c2a5f tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Lock "cinder-quobyte-bc77bb1f-bc7e-465d-8344-db3d78053ace" acquired by "delete_volume" :: waited 0.029s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:48:09 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cab5d0-aca6-488d-9618-1dc8fd3be57d]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:48:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e3763c95-5c87-452e-9aac-3b93f64c2a5f tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc77bb1f-bc7e-465d-8344-db3d78053ace {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:09 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc77bb1f-bc7e-465d-8344-db3d78053ace Aug 27 03:48:09 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:09 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e3763c95-5c87-452e-9aac-3b93f64c2a5f tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc77bb1f-bc7e-465d-8344-db3d78053ace" returned: 0 in 0.563s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e3763c95-5c87-452e-9aac-3b93f64c2a5f tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc77bb1f-bc7e-465d-8344-db3d78053ace {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:09 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc77bb1f-bc7e-465d-8344-db3d78053ace Aug 27 03:48:09 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:10 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e3763c95-5c87-452e-9aac-3b93f64c2a5f tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc77bb1f-bc7e-465d-8344-db3d78053ace" returned: 0 in 0.615s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e3763c95-5c87-452e-9aac-3b93f64c2a5f tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Lock "cinder-quobyte-bc77bb1f-bc7e-465d-8344-db3d78053ace" released by "delete_volume" :: held 1.302s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:48:10 devstack cinder-volume[94328]: WARNING cinder.quota [None req-e3763c95-5c87-452e-9aac-3b93f64c2a5f tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:48:10 devstack cinder-volume[94328]: WARNING cinder.quota [None req-e3763c95-5c87-452e-9aac-3b93f64c2a5f tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:48:10 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-e3763c95-5c87-452e-9aac-3b93f64c2a5f tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Created reservations ['8b96ad72-c21a-4d96-8337-17c79ba7c0a0', 'dc9d43a8-fb5a-43e6-add1-ce34e1cdc540', 'e3920835-d3f9-49f9-94fe-b19ff826761b', 'cb5b718c-a198-4eef-8757-a9ef34379b09'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:48:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e3763c95-5c87-452e-9aac-3b93f64c2a5f tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e3763c95-5c87-452e-9aac-3b93f64c2a5f tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e3763c95-5c87-452e-9aac-3b93f64c2a5f tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e3763c95-5c87-452e-9aac-3b93f64c2a5f tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e3763c95-5c87-452e-9aac-3b93f64c2a5f tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e3763c95-5c87-452e-9aac-3b93f64c2a5f tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:10 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:48:10 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:10 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:48:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Flow 'volume_create_manager' (764d98b2-cccb-4726-9168-4f0ac0ad8070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:48:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (652a51dc-d6b2-4488-9dca-6c9ab9c068fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (652a51dc-d6b2-4488-9dca-6c9ab9c068fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1978579130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=264ef56b-9a50-4b2a-93ba-b46d607b7749,host='devstack@QuobyteHD#QuobyteHD',id=6705f7f7-4091-4ade-8971-649fd2863ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b242e045314eac8bcbf7dc32c878d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:48:11Z,use_quota=True,user_id='169433aa03be45eaaae880dd4318a08f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fe5d68b-c9f3-46f3-84e3-07e66716e62e),volume_type_id=9fe5d68b-c9f3-46f3-84e3-07e66716e62e)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0d29fe-ce86-4bbe-ae4e-f788b14b4d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0d29fe-ce86-4bbe-ae4e-f788b14b4d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465e1a29-b72c-4cb4-a97a-d417c1347021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465e1a29-b72c-4cb4-a97a-d417c1347021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6705f7f7-4091-4ade-8971-649fd2863ee4', 'volume_name': 'volume-6705f7f7-4091-4ade-8971-649fd2863ee4', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77b42c6-7d40-4470-bfd1-36bc0db83788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77b42c6-7d40-4470-bfd1-36bc0db83788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2155f4d-aa0d-481e-9768-fa0af7ccf395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:11 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Volume 6705f7f7-4091-4ade-8971-649fd2863ee4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6705f7f7-4091-4ade-8971-649fd2863ee4', 'volume_size': 1} Aug 27 03:48:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=264ef56b-9a50-4b2a-93ba-b46d607b7749,created_at=2026-08-27T01:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1978579130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=264ef56b-9a50-4b2a-93ba-b46d607b7749,host='devstack@QuobyteHD#QuobyteHD',id=6705f7f7-4091-4ade-8971-649fd2863ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b242e045314eac8bcbf7dc32c878d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:48:11Z,use_quota=True,user_id='169433aa03be45eaaae880dd4318a08f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fe5d68b-c9f3-46f3-84e3-07e66716e62e),volume_type_id=9fe5d68b-c9f3-46f3-84e3-07e66716e62e)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:48:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Creating volume 6705f7f7-4091-4ade-8971-649fd2863ee4 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:48:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:11 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:48:11 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:48:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6705f7f7-4091-4ade-8971-649fd2863ee4 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e3763c95-5c87-452e-9aac-3b93f64c2a5f tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.491s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:11 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-e3763c95-5c87-452e-9aac-3b93f64c2a5f tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:48:11 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e3763c95-5c87-452e-9aac-3b93f64c2a5f tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Deleted volume successfully. Aug 27 03:48:11 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6705f7f7-4091-4ade-8971-649fd2863ee4 1073741824 Aug 27 03:48:11 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e3763c95-5c87-452e-9aac-3b93f64c2a5f tempest-VolumeRetypeWithoutMigrationTest-1833133111 None] Lock "cinder-bc77bb1f-bc7e-465d-8344-db3d78053ace-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:48:12 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6705f7f7-4091-4ade-8971-649fd2863ee4 1073741824" returned: 0 in 0.848s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6705f7f7-4091-4ade-8971-649fd2863ee4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:12 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6705f7f7-4091-4ade-8971-649fd2863ee4 Aug 27 03:48:12 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:12 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6705f7f7-4091-4ade-8971-649fd2863ee4" returned: 0 in 0.486s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:48:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2155f4d-aa0d-481e-9768-fa0af7ccf395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6705f7f7-4091-4ade-8971-649fd2863ee4', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8805475a-555f-40c3-8fbf-44c9fa8a82a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:12 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Volume volume-6705f7f7-4091-4ade-8971-649fd2863ee4 (6705f7f7-4091-4ade-8971-649fd2863ee4): created successfully Aug 27 03:48:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8805475a-555f-40c3-8fbf-44c9fa8a82a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Flow 'volume_create_manager' (764d98b2-cccb-4726-9168-4f0ac0ad8070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:48:12 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-bf001c5e-50d3-4838-b0e0-8ec828d04628 tempest-GroupsTest-755820279 None] Created volume successfully. Aug 27 03:48:13 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d5056fb3-7522-48fb-92bf-4a25efbc52e3 tempest-GroupsTest-755820279 None] Update group completed successfully. Aug 27 03:48:14 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:48:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:14 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:48:14 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:15 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.619s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:48:15 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager._thread_info {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:48:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread count: 28 {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 03:48:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread info: [<_MainThread(MainThread, started 134250325188736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 03:48:15 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-9a75720c-3757-4f22-85fa-7ef27b05a86d tempest-GroupsTest-755820279 None] Update group completed successfully. Aug 27 03:48:17 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] Acquiring lock "cinder-quobyte-5e30b3e6-d452-4185-a64e-26e4a0d97dc5" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:48:17 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] Lock "cinder-quobyte-5e30b3e6-d452-4185-a64e-26e4a0d97dc5" acquired by "delete_volume" :: waited 0.018s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:48:17 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[18758491-c86e-4b8a-84f1-970d40b6fef9]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:48:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e30b3e6-d452-4185-a64e-26e4a0d97dc5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:18 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e30b3e6-d452-4185-a64e-26e4a0d97dc5 Aug 27 03:48:18 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:18 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e30b3e6-d452-4185-a64e-26e4a0d97dc5" returned: 0 in 0.508s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e30b3e6-d452-4185-a64e-26e4a0d97dc5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:18 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e30b3e6-d452-4185-a64e-26e4a0d97dc5 Aug 27 03:48:18 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:18 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5e30b3e6-d452-4185-a64e-26e4a0d97dc5" returned: 0 in 0.331s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] Lock "cinder-quobyte-5e30b3e6-d452-4185-a64e-26e4a0d97dc5" released by "delete_volume" :: held 0.915s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:48:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] Acquiring lock "cinder-quobyte-6705f7f7-4091-4ade-8971-649fd2863ee4" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:48:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] Lock "cinder-quobyte-6705f7f7-4091-4ade-8971-649fd2863ee4" acquired by "delete_volume" :: waited 0.019s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:48:18 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd47a7e-c9c1-4388-8a72-fc257d6cf21a]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:48:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6705f7f7-4091-4ade-8971-649fd2863ee4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:19 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6705f7f7-4091-4ade-8971-649fd2863ee4 Aug 27 03:48:19 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:19 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6705f7f7-4091-4ade-8971-649fd2863ee4" returned: 0 in 0.516s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6705f7f7-4091-4ade-8971-649fd2863ee4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:19 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6705f7f7-4091-4ade-8971-649fd2863ee4 Aug 27 03:48:19 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:19 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6705f7f7-4091-4ade-8971-649fd2863ee4" returned: 0 in 0.372s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] Lock "cinder-quobyte-6705f7f7-4091-4ade-8971-649fd2863ee4" released by "delete_volume" :: held 0.954s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:48:19 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] Created reservations ['8c05a27f-b557-4a5f-964e-8d85d8dba60d'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:48:19 devstack cinder-volume[94328]: WARNING cinder.quota [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2146850933 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2146850933, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:48:19 devstack cinder-volume[94328]: WARNING cinder.quota [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2146850933 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2146850933, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:48:19 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] Created reservations ['5e0c8c1b-efa1-4d10-970a-a3d12694985d', '623cc5a6-0a36-48d9-afcb-141ed6eb8404', '3999fc30-ef8c-4ff8-887e-117442d50eeb', '85bd7575-227e-4026-8ac1-bf539c0b9ec4'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] Created reservations ['66a69a4c-6408-498b-bbc9-47784109d9c0', '39ebae3c-2a87-45c0-82e3-571b7b127606', '27b7a757-f9b3-4bee-adf0-a6d7a511dc84', '903b9586-48ce-430f-ad7e-3ea7c30b5f80'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:20 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:48:20 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Flow 'volume_create_manager' (921ae188-8eb6-449b-8816-43c04784e370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:48:20 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc458ae1-47f4-46c9-8e2e-682e640d3b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.383s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:48:20 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-53f6c5d6-6179-452d-a0d4-b590907f8a50 tempest-GroupsTest-755820279 None] Delete group completed successfully. Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc458ae1-47f4-46c9-8e2e-682e640d3b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-646620333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f685666b-6c54-4cde-97a4-bbf32f1ca16f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97e1caf42874425d9faebd9f09dfafd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:48:20Z,use_quota=True,user_id='22ccc72b86034b52b842dc3be8c8d4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97104046-4e37-4fc3-bac8-84f6c1e3b104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97104046-4e37-4fc3-bac8-84f6c1e3b104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38bd3321-800c-4e80-954d-7014219d3d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38bd3321-800c-4e80-954d-7014219d3d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f685666b-6c54-4cde-97a4-bbf32f1ca16f', 'volume_name': 'volume-f685666b-6c54-4cde-97a4-bbf32f1ca16f', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63e5ae8-c8fa-4138-9bcb-9c0b941754aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63e5ae8-c8fa-4138-9bcb-9c0b941754aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18407417-3b9f-4ddc-a36e-5f03585666ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:20 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Volume f685666b-6c54-4cde-97a4-bbf32f1ca16f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f685666b-6c54-4cde-97a4-bbf32f1ca16f', 'volume_size': 1} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-646620333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f685666b-6c54-4cde-97a4-bbf32f1ca16f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97e1caf42874425d9faebd9f09dfafd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:48:20Z,use_quota=True,user_id='22ccc72b86034b52b842dc3be8c8d4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Creating volume f685666b-6c54-4cde-97a4-bbf32f1ca16f {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:48:20 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:48:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f685666b-6c54-4cde-97a4-bbf32f1ca16f 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:20 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f685666b-6c54-4cde-97a4-bbf32f1ca16f 1073741824 Aug 27 03:48:20 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:21 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f685666b-6c54-4cde-97a4-bbf32f1ca16f 1073741824" returned: 0 in 0.551s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f685666b-6c54-4cde-97a4-bbf32f1ca16f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:21 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f685666b-6c54-4cde-97a4-bbf32f1ca16f Aug 27 03:48:21 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:21 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f685666b-6c54-4cde-97a4-bbf32f1ca16f" returned: 0 in 0.316s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:21 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:48:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18407417-3b9f-4ddc-a36e-5f03585666ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f685666b-6c54-4cde-97a4-bbf32f1ca16f', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54815576-6ea9-4a71-ba5c-3ce63ae84a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:21 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Volume volume-f685666b-6c54-4cde-97a4-bbf32f1ca16f (f685666b-6c54-4cde-97a4-bbf32f1ca16f): created successfully Aug 27 03:48:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54815576-6ea9-4a71-ba5c-3ce63ae84a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Flow 'volume_create_manager' (921ae188-8eb6-449b-8816-43c04784e370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:48:21 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-2b0f7e3d-3ad2-4cfd-b02d-b817bebc73ce tempest-VolumesServicesTestJSON-938103831 None] Created volume successfully. Aug 27 03:48:22 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-783c4688-1ef1-4537-b91b-56ba7dfae8cb tempest-VolumesServicesTestJSON-938103831 None] Acquiring lock "cinder-f685666b-6c54-4cde-97a4-bbf32f1ca16f-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:48:22 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-783c4688-1ef1-4537-b91b-56ba7dfae8cb tempest-VolumesServicesTestJSON-938103831 None] Lock "cinder-f685666b-6c54-4cde-97a4-bbf32f1ca16f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:48:22 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-783c4688-1ef1-4537-b91b-56ba7dfae8cb tempest-VolumesServicesTestJSON-938103831 None] Acquiring lock "cinder-quobyte-f685666b-6c54-4cde-97a4-bbf32f1ca16f" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:48:23 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-783c4688-1ef1-4537-b91b-56ba7dfae8cb tempest-VolumesServicesTestJSON-938103831 None] Lock "cinder-quobyte-f685666b-6c54-4cde-97a4-bbf32f1ca16f" acquired by "delete_volume" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:48:23 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b3e4ab-023f-446c-9dc4-562bdbbed1a1]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:48:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-783c4688-1ef1-4537-b91b-56ba7dfae8cb tempest-VolumesServicesTestJSON-938103831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f685666b-6c54-4cde-97a4-bbf32f1ca16f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:23 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f685666b-6c54-4cde-97a4-bbf32f1ca16f Aug 27 03:48:23 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:23 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-783c4688-1ef1-4537-b91b-56ba7dfae8cb tempest-VolumesServicesTestJSON-938103831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f685666b-6c54-4cde-97a4-bbf32f1ca16f" returned: 0 in 0.507s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-783c4688-1ef1-4537-b91b-56ba7dfae8cb tempest-VolumesServicesTestJSON-938103831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f685666b-6c54-4cde-97a4-bbf32f1ca16f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:23 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f685666b-6c54-4cde-97a4-bbf32f1ca16f Aug 27 03:48:23 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:23 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-783c4688-1ef1-4537-b91b-56ba7dfae8cb tempest-VolumesServicesTestJSON-938103831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f685666b-6c54-4cde-97a4-bbf32f1ca16f" returned: 0 in 0.293s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:23 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-783c4688-1ef1-4537-b91b-56ba7dfae8cb tempest-VolumesServicesTestJSON-938103831 None] Lock "cinder-quobyte-f685666b-6c54-4cde-97a4-bbf32f1ca16f" released by "delete_volume" :: held 0.854s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:48:23 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-783c4688-1ef1-4537-b91b-56ba7dfae8cb tempest-VolumesServicesTestJSON-938103831 None] Created reservations ['1d29bbdc-0740-48dc-939f-60dcbc3d0901', '95e48240-d36d-4dfa-a025-240731784794', '5774af7d-a8f9-4946-aa61-35e92e317082', '5074727e-7fd2-4cdd-8a76-676d1502e6c6'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:48:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-783c4688-1ef1-4537-b91b-56ba7dfae8cb tempest-VolumesServicesTestJSON-938103831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-783c4688-1ef1-4537-b91b-56ba7dfae8cb tempest-VolumesServicesTestJSON-938103831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-783c4688-1ef1-4537-b91b-56ba7dfae8cb tempest-VolumesServicesTestJSON-938103831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-783c4688-1ef1-4537-b91b-56ba7dfae8cb tempest-VolumesServicesTestJSON-938103831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-783c4688-1ef1-4537-b91b-56ba7dfae8cb tempest-VolumesServicesTestJSON-938103831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-783c4688-1ef1-4537-b91b-56ba7dfae8cb tempest-VolumesServicesTestJSON-938103831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:24 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:48:24 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:24 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-783c4688-1ef1-4537-b91b-56ba7dfae8cb tempest-VolumesServicesTestJSON-938103831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.281s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:24 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-783c4688-1ef1-4537-b91b-56ba7dfae8cb tempest-VolumesServicesTestJSON-938103831 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:48:24 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-783c4688-1ef1-4537-b91b-56ba7dfae8cb tempest-VolumesServicesTestJSON-938103831 None] Deleted volume successfully. Aug 27 03:48:24 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-783c4688-1ef1-4537-b91b-56ba7dfae8cb tempest-VolumesServicesTestJSON-938103831 None] Lock "cinder-f685666b-6c54-4cde-97a4-bbf32f1ca16f-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:48:27 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:48:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Flow 'volume_create_manager' (a4d83db4-491f-4e76-8c45-c1d400d49fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:48:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ea131ef-5eb0-402f-a13c-768edf69f69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ea131ef-5eb0-402f-a13c-768edf69f69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1178681757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d183360-86a4-444f-9d61-bae5e985bbb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='910633313bcf4a52a6c06bf790d92d7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:48:28Z,use_quota=True,user_id='e3ccc6c6fc3d4073871719a45c59b55f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e14c86d9-dd97-4dad-af2f-ac84c1e73537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e14c86d9-dd97-4dad-af2f-ac84c1e73537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f892d57e-f9e5-4bb8-b7b0-4a5397ca823b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f892d57e-f9e5-4bb8-b7b0-4a5397ca823b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d183360-86a4-444f-9d61-bae5e985bbb7', 'volume_name': 'volume-6d183360-86a4-444f-9d61-bae5e985bbb7', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f27e793-2d19-40f5-85f5-ffe74d374a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f27e793-2d19-40f5-85f5-ffe74d374a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424db8da-88b4-4e74-baad-bad1d396c490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:27 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Volume 6d183360-86a4-444f-9d61-bae5e985bbb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d183360-86a4-444f-9d61-bae5e985bbb7', 'volume_size': 1} Aug 27 03:48:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1178681757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d183360-86a4-444f-9d61-bae5e985bbb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='910633313bcf4a52a6c06bf790d92d7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:48:28Z,use_quota=True,user_id='e3ccc6c6fc3d4073871719a45c59b55f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:48:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Creating volume 6d183360-86a4-444f-9d61-bae5e985bbb7 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:48:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:48:27 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:48:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d183360-86a4-444f-9d61-bae5e985bbb7 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:28 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d183360-86a4-444f-9d61-bae5e985bbb7 1073741824 Aug 27 03:48:28 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:28 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d183360-86a4-444f-9d61-bae5e985bbb7 1073741824" returned: 0 in 0.734s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d183360-86a4-444f-9d61-bae5e985bbb7 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:28 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d183360-86a4-444f-9d61-bae5e985bbb7 Aug 27 03:48:28 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:29 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d183360-86a4-444f-9d61-bae5e985bbb7" returned: 0 in 0.464s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:48:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424db8da-88b4-4e74-baad-bad1d396c490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d183360-86a4-444f-9d61-bae5e985bbb7', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a956910f-2f11-40bd-9e09-255ac039ea2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:29 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Volume volume-6d183360-86a4-444f-9d61-bae5e985bbb7 (6d183360-86a4-444f-9d61-bae5e985bbb7): created successfully Aug 27 03:48:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a956910f-2f11-40bd-9e09-255ac039ea2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Flow 'volume_create_manager' (a4d83db4-491f-4e76-8c45-c1d400d49fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:48:29 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-eb22dcc8-02d1-47a4-9f8b-7a3184a7386b tempest-VolumesActionsTest-56153050 None] Created volume successfully. Aug 27 03:48:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-dc809f90-dc19-4fc7-9d1f-7abe560d78a2 req-2b8b2d1b-f126-441a-9ce9-60583b173714 tempest-TestStampPattern-1729760105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-dc809f90-dc19-4fc7-9d1f-7abe560d78a2 req-2b8b2d1b-f126-441a-9ce9-60583b173714 tempest-TestStampPattern-1729760105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-dc809f90-dc19-4fc7-9d1f-7abe560d78a2 req-2b8b2d1b-f126-441a-9ce9-60583b173714 tempest-TestStampPattern-1729760105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-dc809f90-dc19-4fc7-9d1f-7abe560d78a2 req-2b8b2d1b-f126-441a-9ce9-60583b173714 tempest-TestStampPattern-1729760105 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac', 'name': 'volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3c45b3ba-a9ab-49de-af1b-36c5525c1c1f', 'enforce_multipath': True} {{(pid=94328) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 27 03:48:29 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-dc809f90-dc19-4fc7-9d1f-7abe560d78a2 req-2b8b2d1b-f126-441a-9ce9-60583b173714 tempest-TestStampPattern-1729760105 None] attachment_update completed successfully. Aug 27 03:48:29 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f7f01141-d4bc-4172-9dd1-fe0cf54ed5ca tempest-GroupsV314Test-1517068599 None] Group tempest-GroupsV314Test-Group-1240707703: creating Aug 27 03:48:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-dfcb37a1-593f-4eb8-8b27-9d7fac3cac13 tempest-VolumesActionsTest-56153050 None] Acquiring lock "cinder-6d183360-86a4-444f-9d61-bae5e985bbb7" by "attach_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:48:29 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f7f01141-d4bc-4172-9dd1-fe0cf54ed5ca tempest-GroupsV314Test-1517068599 None] Group tempest-GroupsV314Test-Group-1240707703: created successfully Aug 27 03:48:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-dfcb37a1-593f-4eb8-8b27-9d7fac3cac13 tempest-VolumesActionsTest-56153050 None] Lock "cinder-6d183360-86a4-444f-9d61-bae5e985bbb7" acquired by "attach_volume" :: waited 0.064s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:48:30 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f7f01141-d4bc-4172-9dd1-fe0cf54ed5ca tempest-GroupsV314Test-1517068599 None] Create group completed successfully. Aug 27 03:48:30 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-dfcb37a1-593f-4eb8-8b27-9d7fac3cac13 tempest-VolumesActionsTest-56153050 None] Attaching volume 6d183360-86a4-444f-9d61-bae5e985bbb7 to instance 845cbf5e-d341-4b75-aa5c-8533467f5282 at mountpoint /dev/vdb on host None. Aug 27 03:48:30 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-dfcb37a1-593f-4eb8-8b27-9d7fac3cac13 tempest-VolumesActionsTest-56153050 None] Attach volume completed successfully. Aug 27 03:48:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-dfcb37a1-593f-4eb8-8b27-9d7fac3cac13 tempest-VolumesActionsTest-56153050 None] Lock "cinder-6d183360-86a4-444f-9d61-bae5e985bbb7" released by "attach_volume" :: held 0.175s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:48:31 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=130,cinder:UPDATE=149,cinder:DELETE=9,cinder:INSERT=39 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:48:31 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=127,cinder:UPDATE=146,cinder:INSERT=28,cinder:DELETE=10 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:48:31 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d406890e-c40c-4f24-87db-0a09e62b262f tempest-VolumesActionsTest-1071313289 None] Terminate volume connection completed successfully. Aug 27 03:48:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d406890e-c40c-4f24-87db-0a09e62b262f tempest-VolumesActionsTest-1071313289 None] Acquiring lock "cinder-6d183360-86a4-444f-9d61-bae5e985bbb7-detach_volume" by "detach_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:48:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d406890e-c40c-4f24-87db-0a09e62b262f tempest-VolumesActionsTest-1071313289 None] Lock "cinder-6d183360-86a4-444f-9d61-bae5e985bbb7-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:48:31 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d406890e-c40c-4f24-87db-0a09e62b262f tempest-VolumesActionsTest-1071313289 None] Detaching volume 6d183360-86a4-444f-9d61-bae5e985bbb7 from instance 845cbf5e-d341-4b75-aa5c-8533467f5282. Aug 27 03:48:31 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d406890e-c40c-4f24-87db-0a09e62b262f tempest-VolumesActionsTest-1071313289 None] Detach volume completed successfully. Aug 27 03:48:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d406890e-c40c-4f24-87db-0a09e62b262f tempest-VolumesActionsTest-1071313289 None] Lock "cinder-6d183360-86a4-444f-9d61-bae5e985bbb7-detach_volume" released by "detach_volume" :: held 0.142s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:48:31 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:48:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Flow 'volume_create_manager' (fe6aa406-3fcc-45d9-9d5c-cfa52662448d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:48:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e953d8-8c05-44f4-b662-16621be5fe19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e953d8-8c05-44f4-b662-16621be5fe19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1330474384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d957430-1348-4e05-9ec9-389b6cf7d208,host='devstack@QuobyteHD#QuobyteHD',id=827f3d34-4f55-4ec9-af4c-82a54f477c63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b69fbf2eb1487cbd3a55b2eb6fec23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:48:32Z,use_quota=True,user_id='8bb4390b5bc4492991c26e1cb353595b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c042b015-a876-405b-80d4-3d338cf01a80),volume_type_id=c042b015-a876-405b-80d4-3d338cf01a80)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82fdfaf2-e65c-47bb-861e-5c81918bd724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82fdfaf2-e65c-47bb-861e-5c81918bd724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa80e6b-2cc4-4385-8b99-64a7f23c2b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa80e6b-2cc4-4385-8b99-64a7f23c2b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '827f3d34-4f55-4ec9-af4c-82a54f477c63', 'volume_name': 'volume-827f3d34-4f55-4ec9-af4c-82a54f477c63', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32cd3598-5b7b-4359-bd6a-973e9bf514a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32cd3598-5b7b-4359-bd6a-973e9bf514a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25954a43-87a3-4d59-abd4-cf0a850641bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:32 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Volume 827f3d34-4f55-4ec9-af4c-82a54f477c63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-827f3d34-4f55-4ec9-af4c-82a54f477c63', 'volume_size': 1} Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8d957430-1348-4e05-9ec9-389b6cf7d208,created_at=2026-08-27T01:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1330474384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d957430-1348-4e05-9ec9-389b6cf7d208,host='devstack@QuobyteHD#QuobyteHD',id=827f3d34-4f55-4ec9-af4c-82a54f477c63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b69fbf2eb1487cbd3a55b2eb6fec23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:48:32Z,use_quota=True,user_id='8bb4390b5bc4492991c26e1cb353595b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c042b015-a876-405b-80d4-3d338cf01a80),volume_type_id=c042b015-a876-405b-80d4-3d338cf01a80)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Creating volume 827f3d34-4f55-4ec9-af4c-82a54f477c63 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:48:32 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d619ad69-148a-4921-8e33-bf766f6aedea tempest-VolumesActionsTest-56153050 None] Acquiring lock "cinder-6d183360-86a4-444f-9d61-bae5e985bbb7-detach_volume" by "detach_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:48:32 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63 1073741824 Aug 27 03:48:32 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d619ad69-148a-4921-8e33-bf766f6aedea tempest-VolumesActionsTest-56153050 None] Lock "cinder-6d183360-86a4-444f-9d61-bae5e985bbb7-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:48:32 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d619ad69-148a-4921-8e33-bf766f6aedea tempest-VolumesActionsTest-56153050 None] Volume detach called, but volume not attached. Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d619ad69-148a-4921-8e33-bf766f6aedea tempest-VolumesActionsTest-56153050 None] Lock "cinder-6d183360-86a4-444f-9d61-bae5e985bbb7-detach_volume" released by "detach_volume" :: held 0.042s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-383c4b40-ee4f-4fad-ab41-723021230bb5 tempest-VolumesActionsTest-56153050 None] Acquiring lock "cinder-6d183360-86a4-444f-9d61-bae5e985bbb7-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-383c4b40-ee4f-4fad-ab41-723021230bb5 tempest-VolumesActionsTest-56153050 None] Lock "cinder-6d183360-86a4-444f-9d61-bae5e985bbb7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-383c4b40-ee4f-4fad-ab41-723021230bb5 tempest-VolumesActionsTest-56153050 None] Acquiring lock "cinder-quobyte-6d183360-86a4-444f-9d61-bae5e985bbb7" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-383c4b40-ee4f-4fad-ab41-723021230bb5 tempest-VolumesActionsTest-56153050 None] Lock "cinder-quobyte-6d183360-86a4-444f-9d61-bae5e985bbb7" acquired by "delete_volume" :: waited 0.028s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8b2709-4a47-4113-9413-00e9930c0f62]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-383c4b40-ee4f-4fad-ab41-723021230bb5 tempest-VolumesActionsTest-56153050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d183360-86a4-444f-9d61-bae5e985bbb7 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:32 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d183360-86a4-444f-9d61-bae5e985bbb7 Aug 27 03:48:32 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:32 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63 1073741824" returned: 0 in 0.906s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:33 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63 Aug 27 03:48:33 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:33 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-383c4b40-ee4f-4fad-ab41-723021230bb5 tempest-VolumesActionsTest-56153050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d183360-86a4-444f-9d61-bae5e985bbb7" returned: 0 in 0.606s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-383c4b40-ee4f-4fad-ab41-723021230bb5 tempest-VolumesActionsTest-56153050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d183360-86a4-444f-9d61-bae5e985bbb7 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:33 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d183360-86a4-444f-9d61-bae5e985bbb7 Aug 27 03:48:33 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:33 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63" returned: 0 in 0.540s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:48:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25954a43-87a3-4d59-abd4-cf0a850641bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-827f3d34-4f55-4ec9-af4c-82a54f477c63', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d438b2-6714-456e-8078-61fb7e56423b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:33 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Volume volume-827f3d34-4f55-4ec9-af4c-82a54f477c63 (827f3d34-4f55-4ec9-af4c-82a54f477c63): created successfully Aug 27 03:48:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d438b2-6714-456e-8078-61fb7e56423b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Flow 'volume_create_manager' (fe6aa406-3fcc-45d9-9d5c-cfa52662448d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:48:33 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e1a813ed-500a-4770-8386-09d2747432eb tempest-GroupsV314Test-1517068599 None] Created volume successfully. Aug 27 03:48:33 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-383c4b40-ee4f-4fad-ab41-723021230bb5 tempest-VolumesActionsTest-56153050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6d183360-86a4-444f-9d61-bae5e985bbb7" returned: 0 in 0.464s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:33 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-383c4b40-ee4f-4fad-ab41-723021230bb5 tempest-VolumesActionsTest-56153050 None] Lock "cinder-quobyte-6d183360-86a4-444f-9d61-bae5e985bbb7" released by "delete_volume" :: held 1.141s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:48:33 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-383c4b40-ee4f-4fad-ab41-723021230bb5 tempest-VolumesActionsTest-56153050 None] Created reservations ['cec50598-c2d8-496a-8b10-d0c13819467f', 'c880e45d-60a8-44b4-8325-ccc91bd2ddf9', '7c275a3b-54f4-4261-8187-ae15ba4102af', 'edea4a05-bdce-4f81-91e3-6b72ab29cdd7'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:48:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-383c4b40-ee4f-4fad-ab41-723021230bb5 tempest-VolumesActionsTest-56153050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-383c4b40-ee4f-4fad-ab41-723021230bb5 tempest-VolumesActionsTest-56153050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-383c4b40-ee4f-4fad-ab41-723021230bb5 tempest-VolumesActionsTest-56153050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-383c4b40-ee4f-4fad-ab41-723021230bb5 tempest-VolumesActionsTest-56153050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-383c4b40-ee4f-4fad-ab41-723021230bb5 tempest-VolumesActionsTest-56153050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-383c4b40-ee4f-4fad-ab41-723021230bb5 tempest-VolumesActionsTest-56153050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:34 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:48:34 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:34 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-383c4b40-ee4f-4fad-ab41-723021230bb5 tempest-VolumesActionsTest-56153050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.274s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:34 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-383c4b40-ee4f-4fad-ab41-723021230bb5 tempest-VolumesActionsTest-56153050 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:48:34 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-383c4b40-ee4f-4fad-ab41-723021230bb5 tempest-VolumesActionsTest-56153050 None] Deleted volume successfully. Aug 27 03:48:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-383c4b40-ee4f-4fad-ab41-723021230bb5 tempest-VolumesActionsTest-56153050 None] Lock "cinder-6d183360-86a4-444f-9d61-bae5e985bbb7-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:48:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:35 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Cloning volume 827f3d34-4f55-4ec9-af4c-82a54f477c63 to volume 30b6c8fe-5687-411a-aac1-f39a5a8c32ea Aug 27 03:48:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Creating offline snapshot 29cd66d5-632d-4498-958b-51dd097b8da4 of volume 827f3d34-4f55-4ec9-af4c-82a54f477c63 {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:48:35 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8888e21-0b37-429c-a7c9-8cee7f170dd9]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:48:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:35 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63 Aug 27 03:48:35 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:36 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63" returned: 0 in 0.733s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.29cd66d5-632d-4498-958b-51dd097b8da4 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:36 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.29cd66d5-632d-4498-958b-51dd097b8da4 1G Aug 27 03:48:36 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:36 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-33f9a6f0-0fd7-4478-b246-42db866216c3 req-cbc8d8de-c682-48b8-af73-06300a30a621 tempest-TestStampPattern-1729760105 None] Terminate volume connection completed successfully. Aug 27 03:48:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-33f9a6f0-0fd7-4478-b246-42db866216c3 req-cbc8d8de-c682-48b8-af73-06300a30a621 tempest-TestStampPattern-1729760105 None] Deleting attachment 3c45b3ba-a9ab-49de-af1b-36c5525c1c1f. {{(pid=94328) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 27 03:48:37 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.29cd66d5-632d-4498-958b-51dd097b8da4 1G" returned: 0 in 0.666s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-827f3d34-4f55-4ec9-af4c-82a54f477c63 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.29cd66d5-632d-4498-958b-51dd097b8da4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:37 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-827f3d34-4f55-4ec9-af4c-82a54f477c63 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.29cd66d5-632d-4498-958b-51dd097b8da4 Aug 27 03:48:37 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-827f3d34-4f55-4ec9-af4c-82a54f477c63 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.29cd66d5-632d-4498-958b-51dd097b8da4" returned: 0 in 0.523s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:37 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.29cd66d5-632d-4498-958b-51dd097b8da4 is being set with open permissions: ugo+rw: NotImplementedError Aug 27 03:48:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.29cd66d5-632d-4498-958b-51dd097b8da4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:37 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:37 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.29cd66d5-632d-4498-958b-51dd097b8da4 Aug 27 03:48:37 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ab1da128-f308-4310-9626-1e0f37780b43 tempest-TestStampPattern-1729760105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:38 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.29cd66d5-632d-4498-958b-51dd097b8da4" returned: 0 in 0.373s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:38 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.info Aug 27 03:48:38 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:38 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.info" returned: 0 in 0.293s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:38 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.info is being set with open permissions: ugo+rw: NotImplementedError Aug 27 03:48:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:38 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.info Aug 27 03:48:38 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:38 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.info" returned: 0 in 0.286s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:38 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Acquiring lock "cinder-quobyte-30b6c8fe-5687-411a-aac1-f39a5a8c32ea" by "_copy_volume_from_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:48:38 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Lock "cinder-quobyte-30b6c8fe-5687-411a-aac1-f39a5a8c32ea" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:48:38 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] snapshot: 29cd66d5-632d-4498-958b-51dd097b8da4, volume: 30b6c8fe-5687-411a-aac1-f39a5a8c32ea, {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 27 03:48:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:38 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:38 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:38 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ad368b-72b8-404d-9357-e4b143581a2c]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:48:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.29cd66d5-632d-4498-958b-51dd097b8da4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:38 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.29cd66d5-632d-4498-958b-51dd097b8da4 Aug 27 03:48:38 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:39 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.29cd66d5-632d-4498-958b-51dd097b8da4" returned: 0 in 0.424s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:39 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-827f3d34-4f55-4ec9-af4c-82a54f477c63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:48:39 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[07511a10-078a-4bf8-9d2d-c1c9a0f1c06e]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:48:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:39 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63 Aug 27 03:48:39 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:39 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:48:39 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Flow 'volume_create_manager' (ff4c17fd-97f6-4ec5-8199-dad3b4657a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:48:39 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e703fab1-d071-43bd-9c5e-3ed883130ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:39 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e703fab1-d071-43bd-9c5e-3ed883130ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-569581515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eeed578-e675-4830-a925-1da48ea52050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='910633313bcf4a52a6c06bf790d92d7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:48:39Z,use_quota=True,user_id='e3ccc6c6fc3d4073871719a45c59b55f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:39 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b1d7e14-a9dd-4bc0-82a6-c3a6f99bbcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:39 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b1d7e14-a9dd-4bc0-82a6-c3a6f99bbcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:39 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb9bb15-a552-4ef4-9ef3-005395701aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:39 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb9bb15-a552-4ef4-9ef3-005395701aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4eeed578-e675-4830-a925-1da48ea52050', 'volume_name': 'volume-4eeed578-e675-4830-a925-1da48ea52050', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:39 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e07ba7-c41e-4917-b9dd-aa1f01019782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:39 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e07ba7-c41e-4917-b9dd-aa1f01019782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:39 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc445cb-e496-4900-a3ae-b85085425894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:39 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Volume 4eeed578-e675-4830-a925-1da48ea52050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4eeed578-e675-4830-a925-1da48ea52050', 'volume_size': 1} Aug 27 03:48:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:39 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63" returned: 0 in 0.397s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:39 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] will copy from snapshot at /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63 {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 27 03:48:39 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Creating direct copy from snapshot {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 27 03:48:39 devstack cinder-volume[94328]: DEBUG cinder.utils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Path /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30b6c8fe-5687-411a-aac1-f39a5a8c32ea not found in is_blk_device check {{(pid=94328) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 27 03:48:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30b6c8fe-5687-411a-aac1-f39a5a8c32ea {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:39 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30b6c8fe-5687-411a-aac1-f39a5a8c32ea Aug 27 03:48:39 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:44 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30b6c8fe-5687-411a-aac1-f39a5a8c32ea" returned: 0 in 4.931s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:44 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Image conversion details: src /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63, size 1024.00 MB, duration 4.93 sec, destination /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30b6c8fe-5687-411a-aac1-f39a5a8c32ea {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:48:44 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Converted 1024.00 MB image at 207.62 MB/s Aug 27 03:48:44 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30b6c8fe-5687-411a-aac1-f39a5a8c32ea is being set with open permissions: ugo+rw: NotImplementedError Aug 27 03:48:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30b6c8fe-5687-411a-aac1-f39a5a8c32ea {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:44 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30b6c8fe-5687-411a-aac1-f39a5a8c32ea Aug 27 03:48:44 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:44 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30b6c8fe-5687-411a-aac1-f39a5a8c32ea" returned: 0 in 0.260s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Lock "cinder-quobyte-30b6c8fe-5687-411a-aac1-f39a5a8c32ea" released by "_copy_volume_from_snapshot" :: held 6.106s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:48:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Acquiring lock "cinder-quobyte-29cd66d5-632d-4498-958b-51dd097b8da4" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:48:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Lock "cinder-quobyte-29cd66d5-632d-4498-958b-51dd097b8da4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:48:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Deleting offline snapshot 29cd66d5-632d-4498-958b-51dd097b8da4 of volume 827f3d34-4f55-4ec9-af4c-82a54f477c63 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:48:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] snapshot_file for this snap is: volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.29cd66d5-632d-4498-958b-51dd097b8da4 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:48:44 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cda277-ca0b-475d-99be-6db11f091c81]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:48:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.29cd66d5-632d-4498-958b-51dd097b8da4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:44 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.29cd66d5-632d-4498-958b-51dd097b8da4 Aug 27 03:48:44 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:45 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.29cd66d5-632d-4498-958b-51dd097b8da4" returned: 0 in 0.383s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:45 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-827f3d34-4f55-4ec9-af4c-82a54f477c63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:48:45 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61d9da5-738a-4f26-922c-b6cf3fe0ff95]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:48:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:45 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63 Aug 27 03:48:45 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:45 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63" returned: 0 in 0.545s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.29cd66d5-632d-4498-958b-51dd097b8da4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:45 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.29cd66d5-632d-4498-958b-51dd097b8da4 Aug 27 03:48:45 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:46 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.29cd66d5-632d-4498-958b-51dd097b8da4" returned: 0 in 0.337s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.29cd66d5-632d-4498-958b-51dd097b8da4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:46 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.29cd66d5-632d-4498-958b-51dd097b8da4 Aug 27 03:48:46 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:46 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63.29cd66d5-632d-4498-958b-51dd097b8da4" returned: 0 in 0.249s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:46 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Lock "cinder-quobyte-29cd66d5-632d-4498-958b-51dd097b8da4" released by "_delete_snapshot" :: held 1.615s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:48:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.844s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ab1da128-f308-4310-9626-1e0f37780b43 tempest-TestStampPattern-1729760105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.673s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:46 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-ab1da128-f308-4310-9626-1e0f37780b43 tempest-TestStampPattern-1729760105 None] Creating offline snapshot 35fbf2f2-e6eb-47be-80a0-b168125fabca of volume ee42fb02-6dfc-46bf-a43c-5addb128c5a0 {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:48:46 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e255232-ff7c-4fb6-8d48-99a151d25928]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:48:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ab1da128-f308-4310-9626-1e0f37780b43 tempest-TestStampPattern-1729760105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:46 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-24ee33aa-b775-4c50-8ffe-9dd26fc837dd tempest-GroupsV314Test-1517068599 None] Create group from source-group-8d957430-1348-4e05-9ec9-389b6cf7d208 completed successfully. Aug 27 03:48:46 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0 Aug 27 03:48:46 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:46 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ab1da128-f308-4310-9626-1e0f37780b43 tempest-TestStampPattern-1729760105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0" returned: 0 in 0.422s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ab1da128-f308-4310-9626-1e0f37780b43 tempest-TestStampPattern-1729760105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.35fbf2f2-e6eb-47be-80a0-b168125fabca 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:46 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.35fbf2f2-e6eb-47be-80a0-b168125fabca 1G Aug 27 03:48:46 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:47 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f439a317-b717-4863-9a2f-804a188a256e tempest-GroupsV314Test-1517068599 None] Acquiring lock "cinder-quobyte-30b6c8fe-5687-411a-aac1-f39a5a8c32ea" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:48:47 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f439a317-b717-4863-9a2f-804a188a256e tempest-GroupsV314Test-1517068599 None] Lock "cinder-quobyte-30b6c8fe-5687-411a-aac1-f39a5a8c32ea" acquired by "delete_volume" :: waited 0.028s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:48:47 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[718346a3-16f9-4c0d-a1e2-16c7de3929d9]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:48:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f439a317-b717-4863-9a2f-804a188a256e tempest-GroupsV314Test-1517068599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30b6c8fe-5687-411a-aac1-f39a5a8c32ea {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:47 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30b6c8fe-5687-411a-aac1-f39a5a8c32ea Aug 27 03:48:47 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:47 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ab1da128-f308-4310-9626-1e0f37780b43 tempest-TestStampPattern-1729760105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.35fbf2f2-e6eb-47be-80a0-b168125fabca 1G" returned: 0 in 0.474s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ab1da128-f308-4310-9626-1e0f37780b43 tempest-TestStampPattern-1729760105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.35fbf2f2-e6eb-47be-80a0-b168125fabca {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:47 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.35fbf2f2-e6eb-47be-80a0-b168125fabca Aug 27 03:48:47 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:47 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f439a317-b717-4863-9a2f-804a188a256e tempest-GroupsV314Test-1517068599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30b6c8fe-5687-411a-aac1-f39a5a8c32ea" returned: 0 in 0.448s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f439a317-b717-4863-9a2f-804a188a256e tempest-GroupsV314Test-1517068599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30b6c8fe-5687-411a-aac1-f39a5a8c32ea {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:47 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30b6c8fe-5687-411a-aac1-f39a5a8c32ea Aug 27 03:48:47 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:47 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ab1da128-f308-4310-9626-1e0f37780b43 tempest-TestStampPattern-1729760105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.35fbf2f2-e6eb-47be-80a0-b168125fabca" returned: 0 in 0.385s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:47 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-ab1da128-f308-4310-9626-1e0f37780b43 tempest-TestStampPattern-1729760105 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.35fbf2f2-e6eb-47be-80a0-b168125fabca is being set with open permissions: ugo+rw Aug 27 03:48:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ab1da128-f308-4310-9626-1e0f37780b43 tempest-TestStampPattern-1729760105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.35fbf2f2-e6eb-47be-80a0-b168125fabca {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:47 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.35fbf2f2-e6eb-47be-80a0-b168125fabca Aug 27 03:48:47 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:47 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f439a317-b717-4863-9a2f-804a188a256e tempest-GroupsV314Test-1517068599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30b6c8fe-5687-411a-aac1-f39a5a8c32ea" returned: 0 in 0.317s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:47 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f439a317-b717-4863-9a2f-804a188a256e tempest-GroupsV314Test-1517068599 None] Lock "cinder-quobyte-30b6c8fe-5687-411a-aac1-f39a5a8c32ea" released by "delete_volume" :: held 0.837s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-f439a317-b717-4863-9a2f-804a188a256e tempest-GroupsV314Test-1517068599 None] Created reservations ['ddb0a509-7ca9-4a8a-b709-df0e725ed1cc'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:48:48 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ab1da128-f308-4310-9626-1e0f37780b43 tempest-TestStampPattern-1729760105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.35fbf2f2-e6eb-47be-80a0-b168125fabca" returned: 0 in 0.284s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:48 devstack cinder-volume[94328]: WARNING cinder.quota [None req-f439a317-b717-4863-9a2f-804a188a256e tempest-GroupsV314Test-1517068599 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-742173813 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-742173813, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:48:48 devstack cinder-volume[94328]: WARNING cinder.quota [None req-f439a317-b717-4863-9a2f-804a188a256e tempest-GroupsV314Test-1517068599 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-742173813 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-742173813, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ab1da128-f308-4310-9626-1e0f37780b43 tempest-TestStampPattern-1729760105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-f439a317-b717-4863-9a2f-804a188a256e tempest-GroupsV314Test-1517068599 None] Created reservations ['96a4849e-7f38-49d3-a8d1-253791bb973e', 'e689beb6-935f-4daf-89ae-e9d727899e96', '0c156d05-99ea-4130-90f0-b5de17af8f6b', '44b75827-7e6e-4c40-9678-c278ce01c7e2'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:48:48 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.info Aug 27 03:48:48 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f439a317-b717-4863-9a2f-804a188a256e tempest-GroupsV314Test-1517068599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f439a317-b717-4863-9a2f-804a188a256e tempest-GroupsV314Test-1517068599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f439a317-b717-4863-9a2f-804a188a256e tempest-GroupsV314Test-1517068599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f439a317-b717-4863-9a2f-804a188a256e tempest-GroupsV314Test-1517068599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f439a317-b717-4863-9a2f-804a188a256e tempest-GroupsV314Test-1517068599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f439a317-b717-4863-9a2f-804a188a256e tempest-GroupsV314Test-1517068599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:48 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:48:48 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:48 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ab1da128-f308-4310-9626-1e0f37780b43 tempest-TestStampPattern-1729760105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.info" returned: 0 in 0.380s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:48 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-ab1da128-f308-4310-9626-1e0f37780b43 tempest-TestStampPattern-1729760105 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.info is being set with open permissions: ugo+rw Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ab1da128-f308-4310-9626-1e0f37780b43 tempest-TestStampPattern-1729760105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:48 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.info Aug 27 03:48:48 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:48 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f439a317-b717-4863-9a2f-804a188a256e tempest-GroupsV314Test-1517068599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.361s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-f439a317-b717-4863-9a2f-804a188a256e tempest-GroupsV314Test-1517068599 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:48:48 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f439a317-b717-4863-9a2f-804a188a256e tempest-GroupsV314Test-1517068599 None] Delete group completed successfully. Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c5da88d3-e272-4b1b-b93b-1e95dc789dab tempest-GroupsV314Test-1517068599 None] Acquiring lock "cinder-quobyte-827f3d34-4f55-4ec9-af4c-82a54f477c63" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c5da88d3-e272-4b1b-b93b-1e95dc789dab tempest-GroupsV314Test-1517068599 None] Lock "cinder-quobyte-827f3d34-4f55-4ec9-af4c-82a54f477c63" acquired by "delete_volume" :: waited 0.021s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[57794d79-0367-4000-812a-84096b1fe515]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c5da88d3-e272-4b1b-b93b-1e95dc789dab tempest-GroupsV314Test-1517068599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:48 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ab1da128-f308-4310-9626-1e0f37780b43 tempest-TestStampPattern-1729760105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.info" returned: 0 in 0.363s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ab1da128-f308-4310-9626-1e0f37780b43 tempest-TestStampPattern-1729760105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.428s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.418s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-569581515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eeed578-e675-4830-a925-1da48ea52050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='910633313bcf4a52a6c06bf790d92d7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:48:39Z,use_quota=True,user_id='e3ccc6c6fc3d4073871719a45c59b55f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Creating volume 4eeed578-e675-4830-a925-1da48ea52050 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:48:48 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:48:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eeed578-e675-4830-a925-1da48ea52050 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:48 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63 Aug 27 03:48:48 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:48 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eeed578-e675-4830-a925-1da48ea52050 1073741824 Aug 27 03:48:48 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:48 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-ab1da128-f308-4310-9626-1e0f37780b43 tempest-TestStampPattern-1729760105 None] Create snapshot completed successfully Aug 27 03:48:49 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c5da88d3-e272-4b1b-b93b-1e95dc789dab tempest-GroupsV314Test-1517068599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63" returned: 0 in 0.394s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c5da88d3-e272-4b1b-b93b-1e95dc789dab tempest-GroupsV314Test-1517068599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:49 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63 Aug 27 03:48:49 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:49 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eeed578-e675-4830-a925-1da48ea52050 1073741824" returned: 0 in 0.546s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:49 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c5da88d3-e272-4b1b-b93b-1e95dc789dab tempest-GroupsV314Test-1517068599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-827f3d34-4f55-4ec9-af4c-82a54f477c63" returned: 0 in 0.302s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c5da88d3-e272-4b1b-b93b-1e95dc789dab tempest-GroupsV314Test-1517068599 None] Lock "cinder-quobyte-827f3d34-4f55-4ec9-af4c-82a54f477c63" released by "delete_volume" :: held 0.769s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:48:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eeed578-e675-4830-a925-1da48ea52050 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:49 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eeed578-e675-4830-a925-1da48ea52050 Aug 27 03:48:49 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:49 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-c5da88d3-e272-4b1b-b93b-1e95dc789dab tempest-GroupsV314Test-1517068599 None] Created reservations ['dc48c6ab-e267-422a-9934-6af364700a4b'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:48:49 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-c5da88d3-e272-4b1b-b93b-1e95dc789dab tempest-GroupsV314Test-1517068599 None] Created reservations ['637e8247-e16c-4b99-9ff2-0c4e05f0b0eb', '40d1d1e8-e7be-4e70-9529-289f4981451b', '2a2a4574-951a-48d7-9ebd-416b346d457b', 'a0ad51d1-380a-45d3-b267-4d81fc83d1f1'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:48:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c5da88d3-e272-4b1b-b93b-1e95dc789dab tempest-GroupsV314Test-1517068599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c5da88d3-e272-4b1b-b93b-1e95dc789dab tempest-GroupsV314Test-1517068599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:49 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c5da88d3-e272-4b1b-b93b-1e95dc789dab tempest-GroupsV314Test-1517068599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:49 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c5da88d3-e272-4b1b-b93b-1e95dc789dab tempest-GroupsV314Test-1517068599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c5da88d3-e272-4b1b-b93b-1e95dc789dab tempest-GroupsV314Test-1517068599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c5da88d3-e272-4b1b-b93b-1e95dc789dab tempest-GroupsV314Test-1517068599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:49 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eeed578-e675-4830-a925-1da48ea52050" returned: 0 in 0.294s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:49 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:48:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:49 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:48:49 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc445cb-e496-4900-a3ae-b85085425894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eeed578-e675-4830-a925-1da48ea52050', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ba4e89-640f-40ec-97b0-7a95d6b29c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:49 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Volume volume-4eeed578-e675-4830-a925-1da48ea52050 (4eeed578-e675-4830-a925-1da48ea52050): created successfully Aug 27 03:48:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ba4e89-640f-40ec-97b0-7a95d6b29c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Flow 'volume_create_manager' (ff4c17fd-97f6-4ec5-8199-dad3b4657a4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:48:49 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-aa9639be-0e03-4715-b91a-408322964057 tempest-VolumesActionsTest-56153050 None] Created volume successfully. Aug 27 03:48:50 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c5da88d3-e272-4b1b-b93b-1e95dc789dab tempest-GroupsV314Test-1517068599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.347s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:50 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-c5da88d3-e272-4b1b-b93b-1e95dc789dab tempest-GroupsV314Test-1517068599 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:48:50 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-c5da88d3-e272-4b1b-b93b-1e95dc789dab tempest-GroupsV314Test-1517068599 None] Delete group completed successfully. Aug 27 03:48:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d1101811-6fd9-40ba-acc1-3dad5aacb391 tempest-VolumesActionsTest-1071313289 None] Acquiring lock "cinder-4eeed578-e675-4830-a925-1da48ea52050-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:48:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d1101811-6fd9-40ba-acc1-3dad5aacb391 tempest-VolumesActionsTest-1071313289 None] Lock "cinder-4eeed578-e675-4830-a925-1da48ea52050-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:48:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d1101811-6fd9-40ba-acc1-3dad5aacb391 tempest-VolumesActionsTest-1071313289 None] Acquiring lock "cinder-quobyte-4eeed578-e675-4830-a925-1da48ea52050" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:48:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d1101811-6fd9-40ba-acc1-3dad5aacb391 tempest-VolumesActionsTest-1071313289 None] Lock "cinder-quobyte-4eeed578-e675-4830-a925-1da48ea52050" acquired by "delete_volume" :: waited 0.026s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:48:50 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d653e05-996c-4889-aa1c-db4755669b73]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:48:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d1101811-6fd9-40ba-acc1-3dad5aacb391 tempest-VolumesActionsTest-1071313289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eeed578-e675-4830-a925-1da48ea52050 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:50 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:48:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Flow 'volume_create_manager' (e8d7e378-7148-4bbd-a55a-eca7decd7cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:48:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (267f667a-4779-47ef-82fa-0cb845ecbd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (267f667a-4779-47ef-82fa-0cb845ecbd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-137198094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42269124-1783-454d-9c4f-e415cd016c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a4b18609813478bbffca76a1cf3d9d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:48:51Z,use_quota=True,user_id='8119387820d0420281e49c730791a70a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf3b4e6-0241-4434-8343-3b4441c8526b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf3b4e6-0241-4434-8343-3b4441c8526b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fcf97a3-19e6-4388-bf6d-a03a07299748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:50 devstack cinder-volume[94328]: DEBUG cinder.image.glance [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Creating Keystone auth plugin from conf {{(pid=94328) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 27 03:48:51 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eeed578-e675-4830-a925-1da48ea52050 Aug 27 03:48:51 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:51 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d1101811-6fd9-40ba-acc1-3dad5aacb391 tempest-VolumesActionsTest-1071313289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eeed578-e675-4830-a925-1da48ea52050" returned: 0 in 0.470s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d1101811-6fd9-40ba-acc1-3dad5aacb391 tempest-VolumesActionsTest-1071313289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eeed578-e675-4830-a925-1da48ea52050 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:51 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eeed578-e675-4830-a925-1da48ea52050 Aug 27 03:48:51 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:51 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fcf97a3-19e6-4388-bf6d-a03a07299748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '42269124-1783-454d-9c4f-e415cd016c78', 'volume_name': 'volume-42269124-1783-454d-9c4f-e415cd016c78', 'volume_size': 1, 'image_id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9b1f4295d504303ad90dfddaa1fb97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'created_at': datetime.datetime(2026, 8, 27, 1, 33, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 33, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f226020c-e698-42bf-8a64-41bbbde77748/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0b3ce2-20ba-49eb-a0b2-0eca261cc39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0b3ce2-20ba-49eb-a0b2-0eca261cc39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15750dfa-6fb6-47b8-a7ff-bb0a150f58d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:51 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Volume 42269124-1783-454d-9c4f-e415cd016c78: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-42269124-1783-454d-9c4f-e415cd016c78', 'volume_size': 1, 'image_id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9b1f4295d504303ad90dfddaa1fb97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'created_at': datetime.datetime(2026, 8, 27, 1, 33, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 33, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f226020c-e698-42bf-8a64-41bbbde77748/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 27 03:48:51 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Trying to clone 42269124-1783-454d-9c4f-e415cd016c78 from image f226020c-e698-42bf-8a64-41bbbde77748 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}]). {{(pid=94328) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 27 03:48:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d1101811-6fd9-40ba-acc1-3dad5aacb391 tempest-VolumesActionsTest-1071313289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eeed578-e675-4830-a925-1da48ea52050" returned: 0 in 0.378s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d1101811-6fd9-40ba-acc1-3dad5aacb391 tempest-VolumesActionsTest-1071313289 None] Lock "cinder-quobyte-4eeed578-e675-4830-a925-1da48ea52050" released by "delete_volume" :: held 0.914s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:48:51 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-d1101811-6fd9-40ba-acc1-3dad5aacb391 tempest-VolumesActionsTest-1071313289 None] Created reservations ['b064ab54-dfdf-4edf-ae1d-cbb0cb096fc3', '07843c23-dee0-4a44-a13c-cf29ee4cdf93', '4bd474ea-ca4c-403f-815a-eacdd4c768b7', '9d9139f9-7643-4624-aa16-4eb9014c1998'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:48:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d1101811-6fd9-40ba-acc1-3dad5aacb391 tempest-VolumesActionsTest-1071313289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d1101811-6fd9-40ba-acc1-3dad5aacb391 tempest-VolumesActionsTest-1071313289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d1101811-6fd9-40ba-acc1-3dad5aacb391 tempest-VolumesActionsTest-1071313289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d1101811-6fd9-40ba-acc1-3dad5aacb391 tempest-VolumesActionsTest-1071313289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d1101811-6fd9-40ba-acc1-3dad5aacb391 tempest-VolumesActionsTest-1071313289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d1101811-6fd9-40ba-acc1-3dad5aacb391 tempest-VolumesActionsTest-1071313289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:52 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:48:52 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:52 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_8ev52x5qdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 27 03:48:52 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Image download 20.69 MB at 20.69 MB/s Aug 27 03:48:52 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bece89-a6d8-4a6b-b676-c6d5a4643320]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:48:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_8ev52x5qdevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:52 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_8ev52x5qdevstack@QuobyteHD Aug 27 03:48:52 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:52 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d1101811-6fd9-40ba-acc1-3dad5aacb391 tempest-VolumesActionsTest-1071313289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.478s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:52 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-d1101811-6fd9-40ba-acc1-3dad5aacb391 tempest-VolumesActionsTest-1071313289 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:48:52 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d1101811-6fd9-40ba-acc1-3dad5aacb391 tempest-VolumesActionsTest-1071313289 None] Deleted volume successfully. Aug 27 03:48:52 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d1101811-6fd9-40ba-acc1-3dad5aacb391 tempest-VolumesActionsTest-1071313289 None] Lock "cinder-4eeed578-e675-4830-a925-1da48ea52050-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:48:52 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_8ev52x5qdevstack@QuobyteHD" returned: 0 in 0.447s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:52 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Temporary image f226020c-e698-42bf-8a64-41bbbde77748 is fetched for user 8119387820d0420281e49c730791a70a. {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 27 03:48:52 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:48:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Flow 'volume_create_manager' (f41acd99-4e44-4708-943b-5384415ae1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:48:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80352c71-d63c-428d-a2c8-2ef6876aa1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80352c71-d63c-428d-a2c8-2ef6876aa1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-666486823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2f4330-d5f4-4c87-8099-16fb0531df31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='910633313bcf4a52a6c06bf790d92d7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:48:53Z,use_quota=True,user_id='e3ccc6c6fc3d4073871719a45c59b55f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731c18cc-0767-4bf3-89cd-9f3f7a56e3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731c18cc-0767-4bf3-89cd-9f3f7a56e3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8005295b-278b-4135-8d89-072aca329b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8005295b-278b-4135-8d89-072aca329b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae2f4330-d5f4-4c87-8099-16fb0531df31', 'volume_name': 'volume-ae2f4330-d5f4-4c87-8099-16fb0531df31', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63a2dd50-4734-4cad-b818-7ab9174882e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63a2dd50-4734-4cad-b818-7ab9174882e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6fdb7e2-36a7-4c25-b3d8-ac7118089ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:53 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Volume ae2f4330-d5f4-4c87-8099-16fb0531df31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae2f4330-d5f4-4c87-8099-16fb0531df31', 'volume_size': 1} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-666486823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2f4330-d5f4-4c87-8099-16fb0531df31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='910633313bcf4a52a6c06bf790d92d7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:48:53Z,use_quota=True,user_id='e3ccc6c6fc3d4073871719a45c59b55f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Creating volume ae2f4330-d5f4-4c87-8099-16fb0531df31 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:48:53 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ae2f4330-d5f4-4c87-8099-16fb0531df31 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:53 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ae2f4330-d5f4-4c87-8099-16fb0531df31 1073741824 Aug 27 03:48:53 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[d340b930-c86b-4f96-8a77-5a78e575c247]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_8ev52x5qdevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:53 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_8ev52x5qdevstack@QuobyteHD Aug 27 03:48:53 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:53 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_8ev52x5qdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:53 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ae2f4330-d5f4-4c87-8099-16fb0531df31 1073741824" returned: 0 in 0.544s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ae2f4330-d5f4-4c87-8099-16fb0531df31 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:53 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ae2f4330-d5f4-4c87-8099-16fb0531df31 Aug 27 03:48:53 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:53 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ae2f4330-d5f4-4c87-8099-16fb0531df31" returned: 0 in 0.341s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.515s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-137198094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42269124-1783-454d-9c4f-e415cd016c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a4b18609813478bbffca76a1cf3d9d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:48:51Z,use_quota=True,user_id='8119387820d0420281e49c730791a70a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Creating volume 42269124-1783-454d-9c4f-e415cd016c78 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:48:53 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:48:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42269124-1783-454d-9c4f-e415cd016c78 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6fdb7e2-36a7-4c25-b3d8-ac7118089ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae2f4330-d5f4-4c87-8099-16fb0531df31', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:54 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42269124-1783-454d-9c4f-e415cd016c78 1073741824 Aug 27 03:48:54 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e27a87-4ad9-4811-b549-7f9bbcb365e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:54 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Volume volume-ae2f4330-d5f4-4c87-8099-16fb0531df31 (ae2f4330-d5f4-4c87-8099-16fb0531df31): created successfully Aug 27 03:48:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e27a87-4ad9-4811-b549-7f9bbcb365e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Flow 'volume_create_manager' (f41acd99-4e44-4708-943b-5384415ae1a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:48:54 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-55a2489a-da79-4025-b7a2-5f611aeb0c97 tempest-VolumesActionsTest-56153050 None] Created volume successfully. Aug 27 03:48:54 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42269124-1783-454d-9c4f-e415cd016c78 1073741824" returned: 0 in 0.558s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42269124-1783-454d-9c4f-e415cd016c78 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:54 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42269124-1783-454d-9c4f-e415cd016c78 Aug 27 03:48:54 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:54 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42269124-1783-454d-9c4f-e415cd016c78" returned: 0 in 0.263s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:54 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:48:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:54 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Attempting download of f226020c-e698-42bf-8a64-41bbbde77748 ((None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}])) to volume 42269124-1783-454d-9c4f-e415cd016c78. {{(pid=94328) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 27 03:48:54 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d24893-be8b-4ebf-93ca-b01bb8b75d95]: (4, 'raw') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:48:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_z9qrpb6k {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:55 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_z9qrpb6k Aug 27 03:48:55 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:55 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6db7674e-6ab8-4a1b-8ba4-7aa84917ff03 tempest-VolumesActionsTest-1071313289 None] Acquiring lock "cinder-ae2f4330-d5f4-4c87-8099-16fb0531df31-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:48:55 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6db7674e-6ab8-4a1b-8ba4-7aa84917ff03 tempest-VolumesActionsTest-1071313289 None] Lock "cinder-ae2f4330-d5f4-4c87-8099-16fb0531df31-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:48:55 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:55 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6db7674e-6ab8-4a1b-8ba4-7aa84917ff03 tempest-VolumesActionsTest-1071313289 None] Acquiring lock "cinder-quobyte-ae2f4330-d5f4-4c87-8099-16fb0531df31" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:48:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_z9qrpb6k" returned: 0 in 0.398s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_z9qrpb6k {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:55 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6db7674e-6ab8-4a1b-8ba4-7aa84917ff03 tempest-VolumesActionsTest-1071313289 None] Lock "cinder-quobyte-ae2f4330-d5f4-4c87-8099-16fb0531df31" acquired by "delete_volume" :: waited 0.057s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:48:55 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c842eb-3b7b-434b-a8fa-7a154ee3c33b]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:48:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6db7674e-6ab8-4a1b-8ba4-7aa84917ff03 tempest-VolumesActionsTest-1071313289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ae2f4330-d5f4-4c87-8099-16fb0531df31 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:55 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_z9qrpb6k Aug 27 03:48:55 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:55 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ae2f4330-d5f4-4c87-8099-16fb0531df31 Aug 27 03:48:55 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:55 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_z9qrpb6k" returned: 1 in 0.402s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_z9qrpb6k' failed. Not Retrying. {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 27 03:48:55 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd034c5c-7c8b-4b0d-9708-b7e1086b5ecd]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:48:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_8ev52x5qdevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:55 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6db7674e-6ab8-4a1b-8ba4-7aa84917ff03 tempest-VolumesActionsTest-1071313289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ae2f4330-d5f4-4c87-8099-16fb0531df31" returned: 0 in 0.427s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6db7674e-6ab8-4a1b-8ba4-7aa84917ff03 tempest-VolumesActionsTest-1071313289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ae2f4330-d5f4-4c87-8099-16fb0531df31 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:55 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_8ev52x5qdevstack@QuobyteHD Aug 27 03:48:55 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:55 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ae2f4330-d5f4-4c87-8099-16fb0531df31 Aug 27 03:48:55 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:56 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6db7674e-6ab8-4a1b-8ba4-7aa84917ff03 tempest-VolumesActionsTest-1071313289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ae2f4330-d5f4-4c87-8099-16fb0531df31" returned: 0 in 0.351s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:56 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:56 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6db7674e-6ab8-4a1b-8ba4-7aa84917ff03 tempest-VolumesActionsTest-1071313289 None] Lock "cinder-quobyte-ae2f4330-d5f4-4c87-8099-16fb0531df31" released by "delete_volume" :: held 0.852s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:48:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_8ev52x5qdevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:56 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] f226020c-e698-42bf-8a64-41bbbde77748 was qcow2, converting to qcow2 {{(pid=94328) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 27 03:48:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_8ev52x5qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42269124-1783-454d-9c4f-e415cd016c78 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:56 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_8ev52x5qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42269124-1783-454d-9c4f-e415cd016c78 Aug 27 03:48:56 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:56 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-6db7674e-6ab8-4a1b-8ba4-7aa84917ff03 tempest-VolumesActionsTest-1071313289 None] Created reservations ['c8ae42f3-e17c-4cd9-991d-0e920851f553', '4820775f-6dac-4786-a57d-0ccd26e1f3f9', '515a1f2b-a667-4947-b68e-b93d33435404', '158d48c7-c054-4864-83de-fd124966e2b1'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:48:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6db7674e-6ab8-4a1b-8ba4-7aa84917ff03 tempest-VolumesActionsTest-1071313289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6db7674e-6ab8-4a1b-8ba4-7aa84917ff03 tempest-VolumesActionsTest-1071313289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:56 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-6db7674e-6ab8-4a1b-8ba4-7aa84917ff03 tempest-VolumesActionsTest-1071313289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:56 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-6db7674e-6ab8-4a1b-8ba4-7aa84917ff03 tempest-VolumesActionsTest-1071313289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6db7674e-6ab8-4a1b-8ba4-7aa84917ff03 tempest-VolumesActionsTest-1071313289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6db7674e-6ab8-4a1b-8ba4-7aa84917ff03 tempest-VolumesActionsTest-1071313289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:56 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:48:56 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:56 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6db7674e-6ab8-4a1b-8ba4-7aa84917ff03 tempest-VolumesActionsTest-1071313289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.314s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:56 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-6db7674e-6ab8-4a1b-8ba4-7aa84917ff03 tempest-VolumesActionsTest-1071313289 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:48:56 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-6db7674e-6ab8-4a1b-8ba4-7aa84917ff03 tempest-VolumesActionsTest-1071313289 None] Deleted volume successfully. Aug 27 03:48:56 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6db7674e-6ab8-4a1b-8ba4-7aa84917ff03 tempest-VolumesActionsTest-1071313289 None] Lock "cinder-ae2f4330-d5f4-4c87-8099-16fb0531df31-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Flow 'volume_create_manager' (527fd81f-f3df-43ff-9cfd-f6c2f95ba1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6265dea2-c613-4c3b-9de4-755d56838f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6265dea2-c613-4c3b-9de4-755d56838f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-667998287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=428e800d-4c56-42b2-9c9e-d93ed2d6f469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='910633313bcf4a52a6c06bf790d92d7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:48:58Z,use_quota=True,user_id='e3ccc6c6fc3d4073871719a45c59b55f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2e76eaa-74f6-482d-b72c-470188687c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2e76eaa-74f6-482d-b72c-470188687c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5844057-4455-4d8e-ad6d-9e9bf80913e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5844057-4455-4d8e-ad6d-9e9bf80913e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '428e800d-4c56-42b2-9c9e-d93ed2d6f469', 'volume_name': 'volume-428e800d-4c56-42b2-9c9e-d93ed2d6f469', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8305ca-79da-478e-8cd5-f91bf2c1c35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8305ca-79da-478e-8cd5-f91bf2c1c35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181b2a1a-348c-43e5-9aa5-270bd1383bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:58 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Volume 428e800d-4c56-42b2-9c9e-d93ed2d6f469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-428e800d-4c56-42b2-9c9e-d93ed2d6f469', 'volume_size': 1} Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-667998287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=428e800d-4c56-42b2-9c9e-d93ed2d6f469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='910633313bcf4a52a6c06bf790d92d7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:48:58Z,use_quota=True,user_id='e3ccc6c6fc3d4073871719a45c59b55f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Creating volume 428e800d-4c56-42b2-9c9e-d93ed2d6f469 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:48:58 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-428e800d-4c56-42b2-9c9e-d93ed2d6f469 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:58 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-428e800d-4c56-42b2-9c9e-d93ed2d6f469 1073741824 Aug 27 03:48:58 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:58 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_8ev52x5qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42269124-1783-454d-9c4f-e415cd016c78" returned: 0 in 2.382s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_8ev52x5qdevstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42269124-1783-454d-9c4f-e415cd016c78 {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:48:58 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Converted 112.00 MB image at 46.99 MB/s Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42269124-1783-454d-9c4f-e415cd016c78 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:58 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42269124-1783-454d-9c4f-e415cd016c78 1G Aug 27 03:48:58 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:58 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-428e800d-4c56-42b2-9c9e-d93ed2d6f469 1073741824" returned: 0 in 0.628s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-428e800d-4c56-42b2-9c9e-d93ed2d6f469 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:59 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-428e800d-4c56-42b2-9c9e-d93ed2d6f469 Aug 27 03:48:59 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:48:59 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42269124-1783-454d-9c4f-e415cd016c78 1G" returned: 0 in 0.531s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Downloaded image f226020c-e698-42bf-8a64-41bbbde77748 ((None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}])) to volume 42269124-1783-454d-9c4f-e415cd016c78 successfully. {{(pid=94328) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Temporary image f226020c-e698-42bf-8a64-41bbbde77748 for user 8119387820d0420281e49c730791a70a is deleted. {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Marking volume 42269124-1783-454d-9c4f-e415cd016c78 as bootable. {{(pid=94328) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Copying metadata from image f226020c-e698-42bf-8a64-41bbbde77748 to 42269124-1783-454d-9c4f-e415cd016c78. {{(pid=94328) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Creating volume glance metadata for volume 42269124-1783-454d-9c4f-e415cd016c78 backed by image f226020c-e698-42bf-8a64-41bbbde77748 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94328) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Flow 'volume_create_manager' (6fa08160-aa71-4e19-ae58-0d06be8881d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e1951e-dfc1-49cc-b14b-f3590a5b34ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e1951e-dfc1-49cc-b14b-f3590a5b34ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-157662582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d2094e3-8104-41d8-a618-8f864841069c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac131be2ec01424daa9cac6311c98d03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=35fbf2f2-e6eb-47be-80a0-b168125fabca,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:48:59Z,use_quota=True,user_id='2c6f9ff434c04c5196aa7827c8e6748c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8c6c80-970c-4161-b3c0-f02f33dccee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8c6c80-970c-4161-b3c0-f02f33dccee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14394b5a-72ac-4348-ab26-6618ef9b9a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14394b5a-72ac-4348-ab26-6618ef9b9a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0d2094e3-8104-41d8-a618-8f864841069c', 'volume_name': 'volume-0d2094e3-8104-41d8-a618-8f864841069c', 'volume_size': 1, 'snapshot_id': '35fbf2f2-e6eb-47be-80a0-b168125fabca'}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73bfec78-ae4d-4771-9ef0-5ce235f4d9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:59 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73bfec78-ae4d-4771-9ef0-5ce235f4d9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af80519-10e1-442d-9928-05d5a6c68336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:59 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Volume 0d2094e3-8104-41d8-a618-8f864841069c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0d2094e3-8104-41d8-a618-8f864841069c', 'volume_size': 1, 'snapshot_id': '35fbf2f2-e6eb-47be-80a0-b168125fabca'} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-428e800d-4c56-42b2-9c9e-d93ed2d6f469" returned: 0 in 0.420s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15750dfa-6fb6-47b8-a7ff-bb0a150f58d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42269124-1783-454d-9c4f-e415cd016c78', 'volume_size': 1, 'image_id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9b1f4295d504303ad90dfddaa1fb97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'created_at': datetime.datetime(2026, 8, 27, 1, 33, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 33, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f226020c-e698-42bf-8a64-41bbbde77748/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f17c20-29ee-4325-b975-a9e778348f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Acquiring lock "cinder-quobyte-35fbf2f2-e6eb-47be-80a0-b168125fabca-0d2094e3-8104-41d8-a618-8f864841069c" by "_create_volume_from_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181b2a1a-348c-43e5-9aa5-270bd1383bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-428e800d-4c56-42b2-9c9e-d93ed2d6f469', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564b218e-ba8a-411a-a3ec-4d6b22f5119a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:48:59 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Volume volume-42269124-1783-454d-9c4f-e415cd016c78 (42269124-1783-454d-9c4f-e415cd016c78): created successfully Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f17c20-29ee-4325-b975-a9e778348f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Flow 'volume_create_manager' (e8d7e378-7148-4bbd-a55a-eca7decd7cdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Lock "cinder-quobyte-35fbf2f2-e6eb-47be-80a0-b168125fabca-0d2094e3-8104-41d8-a618-8f864841069c" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Creating volume 0d2094e3-8104-41d8-a618-8f864841069c from snapshot 35fbf2f2-e6eb-47be-80a0-b168125fabca {{(pid=94328) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Acquiring lock "cinder-quobyte-0d2094e3-8104-41d8-a618-8f864841069c" by "_copy_volume_from_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:48:59 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Volume volume-428e800d-4c56-42b2-9c9e-d93ed2d6f469 (428e800d-4c56-42b2-9c9e-d93ed2d6f469): created successfully Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564b218e-ba8a-411a-a3ec-4d6b22f5119a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Flow 'volume_create_manager' (527fd81f-f3df-43ff-9cfd-f6c2f95ba1d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:48:59 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-48b6bbb2-ff68-45a0-b6ee-862ef90fb5e2 tempest-VolumesExtendTest-1292949280 None] Created volume successfully. Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Lock "cinder-quobyte-0d2094e3-8104-41d8-a618-8f864841069c" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] snapshot: 35fbf2f2-e6eb-47be-80a0-b168125fabca, volume: 0d2094e3-8104-41d8-a618-8f864841069c, {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 27 03:48:59 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-c4f140ec-e7dd-4c86-a6a3-ce742db0649c tempest-VolumesActionsTest-56153050 None] Created volume successfully. Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[334f08d6-d4e0-43a8-be3c-1120ff6bc9b3]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:48:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.35fbf2f2-e6eb-47be-80a0-b168125fabca {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:48:59 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.35fbf2f2-e6eb-47be-80a0-b168125fabca Aug 27 03:48:59 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:00 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.35fbf2f2-e6eb-47be-80a0-b168125fabca" returned: 0 in 0.462s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:49:00 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbe4e0c-44cf-4821-8c80-3db0113f4abf]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:49:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:00 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0 Aug 27 03:49:00 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:00 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ddd5418d-6f07-48e8-861b-c85b1c369488 tempest-VolumesActionsTest-1071313289 None] Acquiring lock "cinder-428e800d-4c56-42b2-9c9e-d93ed2d6f469-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0" returned: 0 in 0.442s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] will copy from snapshot at /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0 {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 27 03:49:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Creating direct copy from snapshot {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 27 03:49:00 devstack cinder-volume[94328]: DEBUG cinder.utils [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Path /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0d2094e3-8104-41d8-a618-8f864841069c not found in is_blk_device check {{(pid=94328) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 27 03:49:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0d2094e3-8104-41d8-a618-8f864841069c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:00 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0d2094e3-8104-41d8-a618-8f864841069c Aug 27 03:49:00 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ddd5418d-6f07-48e8-861b-c85b1c369488 tempest-VolumesActionsTest-1071313289 None] Lock "cinder-428e800d-4c56-42b2-9c9e-d93ed2d6f469-delete_volume" acquired by "delete_volume" :: waited 0.227s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b071cfe6-0918-43b4-9234-408505280239 tempest-VolumesExtendTest-1292949280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ddd5418d-6f07-48e8-861b-c85b1c369488 tempest-VolumesActionsTest-1071313289 None] Acquiring lock "cinder-quobyte-428e800d-4c56-42b2-9c9e-d93ed2d6f469" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ddd5418d-6f07-48e8-861b-c85b1c369488 tempest-VolumesActionsTest-1071313289 None] Lock "cinder-quobyte-428e800d-4c56-42b2-9c9e-d93ed2d6f469" acquired by "delete_volume" :: waited 0.033s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:01 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab12a5c-f68f-4f58-98fd-58e02b5a1cf6]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:49:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ddd5418d-6f07-48e8-861b-c85b1c369488 tempest-VolumesActionsTest-1071313289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-428e800d-4c56-42b2-9c9e-d93ed2d6f469 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:01 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-428e800d-4c56-42b2-9c9e-d93ed2d6f469 Aug 27 03:49:01 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:01 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ddd5418d-6f07-48e8-861b-c85b1c369488 tempest-VolumesActionsTest-1071313289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-428e800d-4c56-42b2-9c9e-d93ed2d6f469" returned: 0 in 0.691s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ddd5418d-6f07-48e8-861b-c85b1c369488 tempest-VolumesActionsTest-1071313289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-428e800d-4c56-42b2-9c9e-d93ed2d6f469 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:01 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-428e800d-4c56-42b2-9c9e-d93ed2d6f469 Aug 27 03:49:01 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:02 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ddd5418d-6f07-48e8-861b-c85b1c369488 tempest-VolumesActionsTest-1071313289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-428e800d-4c56-42b2-9c9e-d93ed2d6f469" returned: 0 in 0.794s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ddd5418d-6f07-48e8-861b-c85b1c369488 tempest-VolumesActionsTest-1071313289 None] Lock "cinder-quobyte-428e800d-4c56-42b2-9c9e-d93ed2d6f469" released by "delete_volume" :: held 1.603s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:02 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-ddd5418d-6f07-48e8-861b-c85b1c369488 tempest-VolumesActionsTest-1071313289 None] Created reservations ['41e3be60-01d2-43c7-bd8e-ea40c31d8f5b', 'f7d1b198-6915-4787-965a-df42bb56a0fd', '994ea4a0-8aeb-49e4-8991-23615ea0ac24', '6b33f51f-aafb-48fd-b2b1-2e8dcb06a0c2'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:49:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ddd5418d-6f07-48e8-861b-c85b1c369488 tempest-VolumesActionsTest-1071313289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ddd5418d-6f07-48e8-861b-c85b1c369488 tempest-VolumesActionsTest-1071313289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:03 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ddd5418d-6f07-48e8-861b-c85b1c369488 tempest-VolumesActionsTest-1071313289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:49:03 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ddd5418d-6f07-48e8-861b-c85b1c369488 tempest-VolumesActionsTest-1071313289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:49:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ddd5418d-6f07-48e8-861b-c85b1c369488 tempest-VolumesActionsTest-1071313289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ddd5418d-6f07-48e8-861b-c85b1c369488 tempest-VolumesActionsTest-1071313289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:03 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:49:03 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:03 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ddd5418d-6f07-48e8-861b-c85b1c369488 tempest-VolumesActionsTest-1071313289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.775s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:03 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-ddd5418d-6f07-48e8-861b-c85b1c369488 tempest-VolumesActionsTest-1071313289 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:49:03 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-ddd5418d-6f07-48e8-861b-c85b1c369488 tempest-VolumesActionsTest-1071313289 None] Deleted volume successfully. Aug 27 03:49:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ddd5418d-6f07-48e8-861b-c85b1c369488 tempest-VolumesActionsTest-1071313289 None] Lock "cinder-428e800d-4c56-42b2-9c9e-d93ed2d6f469-delete_volume" released by "delete_volume" :: held 3.155s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:05 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:49:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Flow 'volume_create_manager' (9b6acd4d-1b28-4286-b3c1-f2b291a963d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:49:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f0cb2e9-f357-41e4-a789-8a27f1c7524d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f0cb2e9-f357-41e4-a789-8a27f1c7524d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1492639546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbdd5d2-f4fa-4f54-a60d-18405fc62834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='910633313bcf4a52a6c06bf790d92d7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:49:05Z,use_quota=True,user_id='e3ccc6c6fc3d4073871719a45c59b55f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac467146-d888-4f40-a5ae-f132924f65fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac467146-d888-4f40-a5ae-f132924f65fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f82532-01b9-468f-9444-dee1399c449f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f82532-01b9-468f-9444-dee1399c449f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cbdd5d2-f4fa-4f54-a60d-18405fc62834', 'volume_name': 'volume-2cbdd5d2-f4fa-4f54-a60d-18405fc62834', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a78662-5bb4-4862-906e-f5d6c8c1574e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a78662-5bb4-4862-906e-f5d6c8c1574e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428ecb6b-9bd6-4314-88fb-0b0799cd80f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:05 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Volume 2cbdd5d2-f4fa-4f54-a60d-18405fc62834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cbdd5d2-f4fa-4f54-a60d-18405fc62834', 'volume_size': 1} Aug 27 03:49:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:08 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0d2094e3-8104-41d8-a618-8f864841069c" returned: 0 in 7.449s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:08 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Image conversion details: src /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0, size 1024.00 MB, duration 7.45 sec, destination /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0d2094e3-8104-41d8-a618-8f864841069c {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:49:08 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Converted 1024.00 MB image at 137.45 MB/s Aug 27 03:49:08 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0d2094e3-8104-41d8-a618-8f864841069c is being set with open permissions: ugo+rw Aug 27 03:49:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0d2094e3-8104-41d8-a618-8f864841069c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:08 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0d2094e3-8104-41d8-a618-8f864841069c Aug 27 03:49:08 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:08 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0d2094e3-8104-41d8-a618-8f864841069c" returned: 0 in 0.330s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Lock "cinder-quobyte-0d2094e3-8104-41d8-a618-8f864841069c" released by "_copy_volume_from_snapshot" :: held 8.803s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Lock "cinder-quobyte-35fbf2f2-e6eb-47be-80a0-b168125fabca-0d2094e3-8104-41d8-a618-8f864841069c" released by "_create_volume_from_snapshot" :: held 8.913s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.951s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b071cfe6-0918-43b4-9234-408505280239 tempest-VolumesExtendTest-1292949280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 7.579s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:08 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[8306a31d-e1d5-4374-ad02-46773adbab6a]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:49:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b071cfe6-0918-43b4-9234-408505280239 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42269124-1783-454d-9c4f-e415cd016c78 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af80519-10e1-442d-9928-05d5a6c68336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d2094e3-8104-41d8-a618-8f864841069c', 'volume_size': 1, 'snapshot_id': '35fbf2f2-e6eb-47be-80a0-b168125fabca'}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a604b4e-6718-4925-9a0a-33ff2192d333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:08 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Volume volume-0d2094e3-8104-41d8-a618-8f864841069c (0d2094e3-8104-41d8-a618-8f864841069c): created successfully Aug 27 03:49:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a604b4e-6718-4925-9a0a-33ff2192d333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Flow 'volume_create_manager' (6fa08160-aa71-4e19-ae58-0d06be8881d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:49:08 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-06974c33-6acd-416c-be88-a89e05eac947 tempest-TestStampPattern-1729760105 None] Created volume successfully. Aug 27 03:49:08 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42269124-1783-454d-9c4f-e415cd016c78 Aug 27 03:49:08 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:08 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b071cfe6-0918-43b4-9234-408505280239 tempest-VolumesExtendTest-1292949280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42269124-1783-454d-9c4f-e415cd016c78" returned: 0 in 0.512s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b071cfe6-0918-43b4-9234-408505280239 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42269124-1783-454d-9c4f-e415cd016c78 2G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b071cfe6-0918-43b4-9234-408505280239 tempest-VolumesExtendTest-1292949280 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42269124-1783-454d-9c4f-e415cd016c78 2G" returned: 0 in 0.132s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b071cfe6-0918-43b4-9234-408505280239 tempest-VolumesExtendTest-1292949280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.681s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.418s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1492639546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbdd5d2-f4fa-4f54-a60d-18405fc62834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='910633313bcf4a52a6c06bf790d92d7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:49:05Z,use_quota=True,user_id='e3ccc6c6fc3d4073871719a45c59b55f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:49:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Creating volume 2cbdd5d2-f4fa-4f54-a60d-18405fc62834 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:49:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:49:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:49:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:49:09 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:49:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cbdd5d2-f4fa-4f54-a60d-18405fc62834 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:09 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cbdd5d2-f4fa-4f54-a60d-18405fc62834 1073741824 Aug 27 03:49:09 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:09 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-b071cfe6-0918-43b4-9234-408505280239 tempest-VolumesExtendTest-1292949280 None] Extend volume completed successfully. Aug 27 03:49:09 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cbdd5d2-f4fa-4f54-a60d-18405fc62834 1073741824" returned: 0 in 0.624s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cbdd5d2-f4fa-4f54-a60d-18405fc62834 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:09 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cbdd5d2-f4fa-4f54-a60d-18405fc62834 Aug 27 03:49:09 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:10 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cbdd5d2-f4fa-4f54-a60d-18405fc62834" returned: 0 in 0.264s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:49:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428ecb6b-9bd6-4314-88fb-0b0799cd80f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cbdd5d2-f4fa-4f54-a60d-18405fc62834', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c408c411-71b5-49e9-a0b6-2ff272761558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:10 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Volume volume-2cbdd5d2-f4fa-4f54-a60d-18405fc62834 (2cbdd5d2-f4fa-4f54-a60d-18405fc62834): created successfully Aug 27 03:49:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c408c411-71b5-49e9-a0b6-2ff272761558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Flow 'volume_create_manager' (9b6acd4d-1b28-4286-b3c1-f2b291a963d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:49:10 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-4a7959e6-9011-4f6a-8af3-2aeb01d337a3 tempest-VolumesActionsTest-56153050 None] Created volume successfully. Aug 27 03:49:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d3bff477-47c8-4b48-8322-3f82dc5ec5a3 tempest-VolumesExtendTest-1292949280 None] Acquiring lock "cinder-42269124-1783-454d-9c4f-e415cd016c78-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d3bff477-47c8-4b48-8322-3f82dc5ec5a3 tempest-VolumesExtendTest-1292949280 None] Lock "cinder-42269124-1783-454d-9c4f-e415cd016c78-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d3bff477-47c8-4b48-8322-3f82dc5ec5a3 tempest-VolumesExtendTest-1292949280 None] Acquiring lock "cinder-quobyte-42269124-1783-454d-9c4f-e415cd016c78" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d3bff477-47c8-4b48-8322-3f82dc5ec5a3 tempest-VolumesExtendTest-1292949280 None] Lock "cinder-quobyte-42269124-1783-454d-9c4f-e415cd016c78" acquired by "delete_volume" :: waited 0.031s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:10 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9db18c-cf2d-4544-83a1-07716bfc6b38]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:49:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d3bff477-47c8-4b48-8322-3f82dc5ec5a3 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42269124-1783-454d-9c4f-e415cd016c78 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-55275c66-618d-4aeb-a83e-301049a69a9c tempest-VolumesActionsTest-1071313289 None] Acquiring lock "cinder-2cbdd5d2-f4fa-4f54-a60d-18405fc62834-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-55275c66-618d-4aeb-a83e-301049a69a9c tempest-VolumesActionsTest-1071313289 None] Lock "cinder-2cbdd5d2-f4fa-4f54-a60d-18405fc62834-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:11 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42269124-1783-454d-9c4f-e415cd016c78 Aug 27 03:49:11 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-55275c66-618d-4aeb-a83e-301049a69a9c tempest-VolumesActionsTest-1071313289 None] Acquiring lock "cinder-quobyte-2cbdd5d2-f4fa-4f54-a60d-18405fc62834" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-55275c66-618d-4aeb-a83e-301049a69a9c tempest-VolumesActionsTest-1071313289 None] Lock "cinder-quobyte-2cbdd5d2-f4fa-4f54-a60d-18405fc62834" acquired by "delete_volume" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:11 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b45e9da-a7c7-4528-8abe-2d317db696aa]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:49:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-55275c66-618d-4aeb-a83e-301049a69a9c tempest-VolumesActionsTest-1071313289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cbdd5d2-f4fa-4f54-a60d-18405fc62834 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:11 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cbdd5d2-f4fa-4f54-a60d-18405fc62834 Aug 27 03:49:11 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:11 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d3bff477-47c8-4b48-8322-3f82dc5ec5a3 tempest-VolumesExtendTest-1292949280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42269124-1783-454d-9c4f-e415cd016c78" returned: 0 in 0.897s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d3bff477-47c8-4b48-8322-3f82dc5ec5a3 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42269124-1783-454d-9c4f-e415cd016c78 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:11 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42269124-1783-454d-9c4f-e415cd016c78 Aug 27 03:49:11 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:12 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-55275c66-618d-4aeb-a83e-301049a69a9c tempest-VolumesActionsTest-1071313289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cbdd5d2-f4fa-4f54-a60d-18405fc62834" returned: 0 in 0.556s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-55275c66-618d-4aeb-a83e-301049a69a9c tempest-VolumesActionsTest-1071313289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cbdd5d2-f4fa-4f54-a60d-18405fc62834 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:12 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cbdd5d2-f4fa-4f54-a60d-18405fc62834 Aug 27 03:49:12 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:12 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d3bff477-47c8-4b48-8322-3f82dc5ec5a3 tempest-VolumesExtendTest-1292949280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-42269124-1783-454d-9c4f-e415cd016c78" returned: 0 in 0.335s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d3bff477-47c8-4b48-8322-3f82dc5ec5a3 tempest-VolumesExtendTest-1292949280 None] Lock "cinder-quobyte-42269124-1783-454d-9c4f-e415cd016c78" released by "delete_volume" :: held 1.351s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:12 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-d3bff477-47c8-4b48-8322-3f82dc5ec5a3 tempest-VolumesExtendTest-1292949280 None] Created reservations ['21f5ff9d-ffda-406d-a6ab-08cea8fa3b08', '3433d255-c270-42a0-b78a-efb7aa78589e', '28822a19-baac-41fb-8652-53ed42110e75', 'f095d1f7-6066-49be-af68-c940bee9ce53'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:49:12 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-55275c66-618d-4aeb-a83e-301049a69a9c tempest-VolumesActionsTest-1071313289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cbdd5d2-f4fa-4f54-a60d-18405fc62834" returned: 0 in 0.321s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d3bff477-47c8-4b48-8322-3f82dc5ec5a3 tempest-VolumesExtendTest-1292949280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d3bff477-47c8-4b48-8322-3f82dc5ec5a3 tempest-VolumesExtendTest-1292949280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d3bff477-47c8-4b48-8322-3f82dc5ec5a3 tempest-VolumesExtendTest-1292949280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:49:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d3bff477-47c8-4b48-8322-3f82dc5ec5a3 tempest-VolumesExtendTest-1292949280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:49:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d3bff477-47c8-4b48-8322-3f82dc5ec5a3 tempest-VolumesExtendTest-1292949280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d3bff477-47c8-4b48-8322-3f82dc5ec5a3 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-55275c66-618d-4aeb-a83e-301049a69a9c tempest-VolumesActionsTest-1071313289 None] Lock "cinder-quobyte-2cbdd5d2-f4fa-4f54-a60d-18405fc62834" released by "delete_volume" :: held 0.989s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:12 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:49:12 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:12 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-55275c66-618d-4aeb-a83e-301049a69a9c tempest-VolumesActionsTest-1071313289 None] Created reservations ['9c376db8-adca-4e48-ae77-1d6aaa11773d', 'e25c9e20-3667-4833-a433-637268037cc9', '7a755ba8-8643-4a3e-98b3-63f6d5590166', '38a3b690-7052-4741-89c4-f4a984cc79f7'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:49:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-55275c66-618d-4aeb-a83e-301049a69a9c tempest-VolumesActionsTest-1071313289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-55275c66-618d-4aeb-a83e-301049a69a9c tempest-VolumesActionsTest-1071313289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-55275c66-618d-4aeb-a83e-301049a69a9c tempest-VolumesActionsTest-1071313289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:49:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-55275c66-618d-4aeb-a83e-301049a69a9c tempest-VolumesActionsTest-1071313289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:49:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-55275c66-618d-4aeb-a83e-301049a69a9c tempest-VolumesActionsTest-1071313289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-55275c66-618d-4aeb-a83e-301049a69a9c tempest-VolumesActionsTest-1071313289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:12 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:49:12 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:12 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d3bff477-47c8-4b48-8322-3f82dc5ec5a3 tempest-VolumesExtendTest-1292949280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.432s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:12 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-d3bff477-47c8-4b48-8322-3f82dc5ec5a3 tempest-VolumesExtendTest-1292949280 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:49:12 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d3bff477-47c8-4b48-8322-3f82dc5ec5a3 tempest-VolumesExtendTest-1292949280 None] Deleted volume successfully. Aug 27 03:49:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d3bff477-47c8-4b48-8322-3f82dc5ec5a3 tempest-VolumesExtendTest-1292949280 None] Lock "cinder-42269124-1783-454d-9c4f-e415cd016c78-delete_volume" released by "delete_volume" :: held 2.181s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:13 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-55275c66-618d-4aeb-a83e-301049a69a9c tempest-VolumesActionsTest-1071313289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.431s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:13 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-55275c66-618d-4aeb-a83e-301049a69a9c tempest-VolumesActionsTest-1071313289 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:49:13 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-55275c66-618d-4aeb-a83e-301049a69a9c tempest-VolumesActionsTest-1071313289 None] Deleted volume successfully. Aug 27 03:49:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-55275c66-618d-4aeb-a83e-301049a69a9c tempest-VolumesActionsTest-1071313289 None] Lock "cinder-2cbdd5d2-f4fa-4f54-a60d-18405fc62834-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Flow 'volume_create_manager' (9b8dad3c-1c8e-4789-bf39-b5a974173d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12592898-f044-4f5e-ac3a-3fb8f9b7cc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12592898-f044-4f5e-ac3a-3fb8f9b7cc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-729435381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4adaaa-bac8-4780-bc27-ecb3906a7f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a4b18609813478bbffca76a1cf3d9d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:49:14Z,use_quota=True,user_id='8119387820d0420281e49c730791a70a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81cb0ca3-f3b3-4cdc-bf8c-da7e175875bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81cb0ca3-f3b3-4cdc-bf8c-da7e175875bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a175f2-60c4-4ad1-b5bb-feb5291afcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a175f2-60c4-4ad1-b5bb-feb5291afcb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b4adaaa-bac8-4780-bc27-ecb3906a7f26', 'volume_name': 'volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2200ee2f-f05b-48b7-8c06-6f2f1fe4f562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2200ee2f-f05b-48b7-8c06-6f2f1fe4f562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99b2193-c3fb-4e69-a671-3820f64e751f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:14 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Volume 9b4adaaa-bac8-4780-bc27-ecb3906a7f26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26', 'volume_size': 1} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-729435381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4adaaa-bac8-4780-bc27-ecb3906a7f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a4b18609813478bbffca76a1cf3d9d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:49:14Z,use_quota=True,user_id='8119387820d0420281e49c730791a70a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Creating volume 9b4adaaa-bac8-4780-bc27-ecb3906a7f26 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:49:14 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:14 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26 1073741824 Aug 27 03:49:14 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:15 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:49:15 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Flow 'volume_create_manager' (63ff12de-61f0-4944-b645-0ad90c96f4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5534d5df-2765-4c60-a313-cbba357847df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5534d5df-2765-4c60-a313-cbba357847df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-123410978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac67a66c-688e-4ff3-ad45-8871647da514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='910633313bcf4a52a6c06bf790d92d7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:49:15Z,use_quota=True,user_id='e3ccc6c6fc3d4073871719a45c59b55f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe58c880-3ca5-4462-88f5-09ca306793ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe58c880-3ca5-4462-88f5-09ca306793ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c50b274-0012-4e9d-b5b9-eccf4fbceefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c50b274-0012-4e9d-b5b9-eccf4fbceefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac67a66c-688e-4ff3-ad45-8871647da514', 'volume_name': 'volume-ac67a66c-688e-4ff3-ad45-8871647da514', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555487ee-eebe-4a5b-9b28-eb1cc667149e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555487ee-eebe-4a5b-9b28-eb1cc667149e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b708771-27fd-4efa-8e68-3f6e3ed44f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:15 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Volume ac67a66c-688e-4ff3-ad45-8871647da514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac67a66c-688e-4ff3-ad45-8871647da514', 'volume_size': 1} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:15 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26 1073741824" returned: 0 in 1.106s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:15 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.598s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager._thread_info {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread count: 28 {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread info: [<_MainThread(MainThread, started 134250325188736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:15 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26 Aug 27 03:49:15 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:15 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26" returned: 0 in 0.358s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.691s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-123410978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac67a66c-688e-4ff3-ad45-8871647da514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='910633313bcf4a52a6c06bf790d92d7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:49:15Z,use_quota=True,user_id='e3ccc6c6fc3d4073871719a45c59b55f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Creating volume ac67a66c-688e-4ff3-ad45-8871647da514 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:49:15 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac67a66c-688e-4ff3-ad45-8871647da514 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99b2193-c3fb-4e69-a671-3820f64e751f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:15 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac67a66c-688e-4ff3-ad45-8871647da514 1073741824 Aug 27 03:49:15 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc805dc-8d80-4545-a833-aa3692ffc6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:16 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Volume volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26 (9b4adaaa-bac8-4780-bc27-ecb3906a7f26): created successfully Aug 27 03:49:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc805dc-8d80-4545-a833-aa3692ffc6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Flow 'volume_create_manager' (9b8dad3c-1c8e-4789-bf39-b5a974173d1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:49:16 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-a653f1ee-2d74-4407-84b9-216b8742d4f4 tempest-VolumesExtendTest-1292949280 None] Created volume successfully. Aug 27 03:49:16 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac67a66c-688e-4ff3-ad45-8871647da514 1073741824" returned: 0 in 0.724s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac67a66c-688e-4ff3-ad45-8871647da514 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:16 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac67a66c-688e-4ff3-ad45-8871647da514 Aug 27 03:49:16 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:17 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac67a66c-688e-4ff3-ad45-8871647da514" returned: 0 in 0.398s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:17 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:49:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:17 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b708771-27fd-4efa-8e68-3f6e3ed44f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac67a66c-688e-4ff3-ad45-8871647da514', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:17 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd5dc628-76f9-4e3c-bbba-5087ad5a6ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:17 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Volume volume-ac67a66c-688e-4ff3-ad45-8871647da514 (ac67a66c-688e-4ff3-ad45-8871647da514): created successfully Aug 27 03:49:17 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd5dc628-76f9-4e3c-bbba-5087ad5a6ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:17 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Flow 'volume_create_manager' (63ff12de-61f0-4944-b645-0ad90c96f4be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:49:17 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-65f272ce-d16e-4b01-a961-4a236a96be23 tempest-VolumesActionsTest-56153050 None] Created volume successfully. Aug 27 03:49:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a4c7351c-adb0-40b1-b3cb-68a5f0875594 tempest-VolumesExtendTest-1292949280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a4c7351c-adb0-40b1-b3cb-68a5f0875594 tempest-VolumesExtendTest-1292949280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:17 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-a4c7351c-adb0-40b1-b3cb-68a5f0875594 tempest-VolumesExtendTest-1292949280 None] Creating offline snapshot 0d359ee0-d927-46df-b8f8-110e5c97777d of volume 9b4adaaa-bac8-4780-bc27-ecb3906a7f26 {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:49:17 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c17db27-2b32-463a-b729-265547fd77cc]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:49:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a4c7351c-adb0-40b1-b3cb-68a5f0875594 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:17 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26 Aug 27 03:49:17 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:18 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a4c7351c-adb0-40b1-b3cb-68a5f0875594 tempest-VolumesExtendTest-1292949280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26" returned: 0 in 0.523s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a4c7351c-adb0-40b1-b3cb-68a5f0875594 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.0d359ee0-d927-46df-b8f8-110e5c97777d 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:18 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.0d359ee0-d927-46df-b8f8-110e5c97777d 1G Aug 27 03:49:18 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:18 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a4c7351c-adb0-40b1-b3cb-68a5f0875594 tempest-VolumesExtendTest-1292949280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.0d359ee0-d927-46df-b8f8-110e5c97777d 1G" returned: 0 in 0.895s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a4c7351c-adb0-40b1-b3cb-68a5f0875594 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.0d359ee0-d927-46df-b8f8-110e5c97777d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:18 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.0d359ee0-d927-46df-b8f8-110e5c97777d Aug 27 03:49:18 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-dbfff27f-9b18-4334-b54d-3c5ac2b18ec1 tempest-VolumesActionsTest-56153050 None] Acquiring lock "cinder-ac67a66c-688e-4ff3-ad45-8871647da514-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-dbfff27f-9b18-4334-b54d-3c5ac2b18ec1 tempest-VolumesActionsTest-56153050 None] Lock "cinder-ac67a66c-688e-4ff3-ad45-8871647da514-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-dbfff27f-9b18-4334-b54d-3c5ac2b18ec1 tempest-VolumesActionsTest-56153050 None] Acquiring lock "cinder-quobyte-ac67a66c-688e-4ff3-ad45-8871647da514" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-dbfff27f-9b18-4334-b54d-3c5ac2b18ec1 tempest-VolumesActionsTest-56153050 None] Lock "cinder-quobyte-ac67a66c-688e-4ff3-ad45-8871647da514" acquired by "delete_volume" :: waited 0.030s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:19 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa9aabe-2402-4fb6-9fda-d930a2807df9]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:49:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbfff27f-9b18-4334-b54d-3c5ac2b18ec1 tempest-VolumesActionsTest-56153050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac67a66c-688e-4ff3-ad45-8871647da514 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:19 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a4c7351c-adb0-40b1-b3cb-68a5f0875594 tempest-VolumesExtendTest-1292949280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.0d359ee0-d927-46df-b8f8-110e5c97777d" returned: 0 in 0.517s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:19 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-a4c7351c-adb0-40b1-b3cb-68a5f0875594 tempest-VolumesExtendTest-1292949280 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.0d359ee0-d927-46df-b8f8-110e5c97777d is being set with open permissions: ugo+rw Aug 27 03:49:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a4c7351c-adb0-40b1-b3cb-68a5f0875594 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.0d359ee0-d927-46df-b8f8-110e5c97777d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:19 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.0d359ee0-d927-46df-b8f8-110e5c97777d Aug 27 03:49:19 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:19 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac67a66c-688e-4ff3-ad45-8871647da514 Aug 27 03:49:19 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:19 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a4c7351c-adb0-40b1-b3cb-68a5f0875594 tempest-VolumesExtendTest-1292949280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.0d359ee0-d927-46df-b8f8-110e5c97777d" returned: 0 in 0.384s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a4c7351c-adb0-40b1-b3cb-68a5f0875594 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:19 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.info Aug 27 03:49:19 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:20 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbfff27f-9b18-4334-b54d-3c5ac2b18ec1 tempest-VolumesActionsTest-56153050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac67a66c-688e-4ff3-ad45-8871647da514" returned: 0 in 0.658s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbfff27f-9b18-4334-b54d-3c5ac2b18ec1 tempest-VolumesActionsTest-56153050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac67a66c-688e-4ff3-ad45-8871647da514 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:20 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac67a66c-688e-4ff3-ad45-8871647da514 Aug 27 03:49:20 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:20 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a4c7351c-adb0-40b1-b3cb-68a5f0875594 tempest-VolumesExtendTest-1292949280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.info" returned: 0 in 0.396s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:20 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-a4c7351c-adb0-40b1-b3cb-68a5f0875594 tempest-VolumesExtendTest-1292949280 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.info is being set with open permissions: ugo+rw Aug 27 03:49:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a4c7351c-adb0-40b1-b3cb-68a5f0875594 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:20 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.info Aug 27 03:49:20 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:20 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbfff27f-9b18-4334-b54d-3c5ac2b18ec1 tempest-VolumesActionsTest-56153050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ac67a66c-688e-4ff3-ad45-8871647da514" returned: 0 in 0.400s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-dbfff27f-9b18-4334-b54d-3c5ac2b18ec1 tempest-VolumesActionsTest-56153050 None] Lock "cinder-quobyte-ac67a66c-688e-4ff3-ad45-8871647da514" released by "delete_volume" :: held 1.151s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:20 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-dbfff27f-9b18-4334-b54d-3c5ac2b18ec1 tempest-VolumesActionsTest-56153050 None] Created reservations ['8987a8f6-e379-4cdc-8ed1-35dfba033ec9', 'af3c422d-54f9-414e-93be-d01121ebe8a5', '14773aa4-c09b-41e0-98be-f4781ed30188', '0b0f1363-9832-4a4e-aaaa-89267169c985'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:49:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dbfff27f-9b18-4334-b54d-3c5ac2b18ec1 tempest-VolumesActionsTest-56153050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dbfff27f-9b18-4334-b54d-3c5ac2b18ec1 tempest-VolumesActionsTest-56153050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-dbfff27f-9b18-4334-b54d-3c5ac2b18ec1 tempest-VolumesActionsTest-56153050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:49:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-dbfff27f-9b18-4334-b54d-3c5ac2b18ec1 tempest-VolumesActionsTest-56153050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:49:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dbfff27f-9b18-4334-b54d-3c5ac2b18ec1 tempest-VolumesActionsTest-56153050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbfff27f-9b18-4334-b54d-3c5ac2b18ec1 tempest-VolumesActionsTest-56153050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:20 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a4c7351c-adb0-40b1-b3cb-68a5f0875594 tempest-VolumesExtendTest-1292949280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.info" returned: 0 in 0.363s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:20 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:49:20 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a4c7351c-adb0-40b1-b3cb-68a5f0875594 tempest-VolumesExtendTest-1292949280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.267s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:20 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-a4c7351c-adb0-40b1-b3cb-68a5f0875594 tempest-VolumesExtendTest-1292949280 None] Create snapshot completed successfully Aug 27 03:49:21 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbfff27f-9b18-4334-b54d-3c5ac2b18ec1 tempest-VolumesActionsTest-56153050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.314s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:21 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-dbfff27f-9b18-4334-b54d-3c5ac2b18ec1 tempest-VolumesActionsTest-56153050 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:49:21 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-dbfff27f-9b18-4334-b54d-3c5ac2b18ec1 tempest-VolumesActionsTest-56153050 None] Deleted volume successfully. Aug 27 03:49:21 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-dbfff27f-9b18-4334-b54d-3c5ac2b18ec1 tempest-VolumesActionsTest-56153050 None] Lock "cinder-ac67a66c-688e-4ff3-ad45-8871647da514-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c428e92e-d658-44e7-8d8d-711134078606 tempest-VolumesExtendTest-1292949280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c428e92e-d658-44e7-8d8d-711134078606 tempest-VolumesExtendTest-1292949280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:21 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec596954-44fa-422e-ad17-22f449d4d36c]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:49:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c428e92e-d658-44e7-8d8d-711134078606 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:22 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26 Aug 27 03:49:22 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:22 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c428e92e-d658-44e7-8d8d-711134078606 tempest-VolumesExtendTest-1292949280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26" returned: 0 in 0.546s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c428e92e-d658-44e7-8d8d-711134078606 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.0d359ee0-d927-46df-b8f8-110e5c97777d 2G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c428e92e-d658-44e7-8d8d-711134078606 tempest-VolumesExtendTest-1292949280 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.0d359ee0-d927-46df-b8f8-110e5c97777d 2G" returned: 0 in 0.213s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c428e92e-d658-44e7-8d8d-711134078606 tempest-VolumesExtendTest-1292949280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.801s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:22 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-c428e92e-d658-44e7-8d8d-711134078606 tempest-VolumesExtendTest-1292949280 None] Extend volume completed successfully. Aug 27 03:49:23 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-19766c47-aa28-4ed1-a173-ba7f4fcc2b31 tempest-VolumesExtendTest-1292949280 None] Acquiring lock "cinder-0d359ee0-d927-46df-b8f8-110e5c97777d-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:23 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-19766c47-aa28-4ed1-a173-ba7f4fcc2b31 tempest-VolumesExtendTest-1292949280 None] Lock "cinder-0d359ee0-d927-46df-b8f8-110e5c97777d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:23 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-19766c47-aa28-4ed1-a173-ba7f4fcc2b31 tempest-VolumesExtendTest-1292949280 None] Acquiring lock "cinder-quobyte-9b4adaaa-bac8-4780-bc27-ecb3906a7f26" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:23 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-19766c47-aa28-4ed1-a173-ba7f4fcc2b31 tempest-VolumesExtendTest-1292949280 None] Lock "cinder-quobyte-9b4adaaa-bac8-4780-bc27-ecb3906a7f26" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:23 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-19766c47-aa28-4ed1-a173-ba7f4fcc2b31 tempest-VolumesExtendTest-1292949280 None] Acquiring lock "cinder-quobyte-0d359ee0-d927-46df-b8f8-110e5c97777d" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:23 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-19766c47-aa28-4ed1-a173-ba7f4fcc2b31 tempest-VolumesExtendTest-1292949280 None] Lock "cinder-quobyte-0d359ee0-d927-46df-b8f8-110e5c97777d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:23 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-19766c47-aa28-4ed1-a173-ba7f4fcc2b31 tempest-VolumesExtendTest-1292949280 None] Deleting offline snapshot 0d359ee0-d927-46df-b8f8-110e5c97777d of volume 9b4adaaa-bac8-4780-bc27-ecb3906a7f26 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:49:23 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-19766c47-aa28-4ed1-a173-ba7f4fcc2b31 tempest-VolumesExtendTest-1292949280 None] snapshot_file for this snap is: volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.0d359ee0-d927-46df-b8f8-110e5c97777d {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:49:23 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffeb3af-4a19-462f-8ff4-b7cedb906990]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:49:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-19766c47-aa28-4ed1-a173-ba7f4fcc2b31 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.0d359ee0-d927-46df-b8f8-110e5c97777d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:23 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.0d359ee0-d927-46df-b8f8-110e5c97777d Aug 27 03:49:23 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:24 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-19766c47-aa28-4ed1-a173-ba7f4fcc2b31 tempest-VolumesExtendTest-1292949280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.0d359ee0-d927-46df-b8f8-110e5c97777d" returned: 0 in 0.571s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-19766c47-aa28-4ed1-a173-ba7f4fcc2b31 tempest-VolumesExtendTest-1292949280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:49:24 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2188855-bad6-41f0-835e-2c3811209f48]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:49:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-19766c47-aa28-4ed1-a173-ba7f4fcc2b31 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:24 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26 Aug 27 03:49:24 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:24 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-19766c47-aa28-4ed1-a173-ba7f4fcc2b31 tempest-VolumesExtendTest-1292949280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26" returned: 0 in 0.602s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-19766c47-aa28-4ed1-a173-ba7f4fcc2b31 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.0d359ee0-d927-46df-b8f8-110e5c97777d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:24 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.0d359ee0-d927-46df-b8f8-110e5c97777d Aug 27 03:49:24 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Flow 'volume_create_manager' (14d31b1a-b874-4fb0-a9d4-3fd06118ea41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14721338-973b-410f-97f5-b7633c48679c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14721338-973b-410f-97f5-b7633c48679c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1915607664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45962f14-99a7-400f-b18e-4a22194e6c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4fde298a8b4fa5a47c36fa0ce2fa31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:49:25Z,use_quota=True,user_id='3e49adcb66834dffa64fcae3a0909691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3adefd5f-3e3f-49ee-adcb-b96506927d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3adefd5f-3e3f-49ee-adcb-b96506927d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c39f20-8d86-426b-b0e0-191de98f9cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c39f20-8d86-426b-b0e0-191de98f9cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45962f14-99a7-400f-b18e-4a22194e6c67', 'volume_name': 'volume-45962f14-99a7-400f-b18e-4a22194e6c67', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def02ace-ab62-4b78-9bb1-04d0eacc3648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def02ace-ab62-4b78-9bb1-04d0eacc3648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643791d8-92e2-4f09-bdce-c4eff7e4bbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:25 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Volume 45962f14-99a7-400f-b18e-4a22194e6c67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45962f14-99a7-400f-b18e-4a22194e6c67', 'volume_size': 1} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1915607664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45962f14-99a7-400f-b18e-4a22194e6c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4fde298a8b4fa5a47c36fa0ce2fa31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:49:25Z,use_quota=True,user_id='3e49adcb66834dffa64fcae3a0909691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Creating volume 45962f14-99a7-400f-b18e-4a22194e6c67 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:49:25 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:25 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67 1073741824 Aug 27 03:49:25 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:25 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-19766c47-aa28-4ed1-a173-ba7f4fcc2b31 tempest-VolumesExtendTest-1292949280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.0d359ee0-d927-46df-b8f8-110e5c97777d" returned: 0 in 0.624s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-19766c47-aa28-4ed1-a173-ba7f4fcc2b31 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.0d359ee0-d927-46df-b8f8-110e5c97777d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:25 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.0d359ee0-d927-46df-b8f8-110e5c97777d Aug 27 03:49:25 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:25 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-19766c47-aa28-4ed1-a173-ba7f4fcc2b31 tempest-VolumesExtendTest-1292949280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26.0d359ee0-d927-46df-b8f8-110e5c97777d" returned: 0 in 0.323s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-19766c47-aa28-4ed1-a173-ba7f4fcc2b31 tempest-VolumesExtendTest-1292949280 None] Lock "cinder-quobyte-0d359ee0-d927-46df-b8f8-110e5c97777d" released by "_delete_snapshot" :: held 2.266s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-19766c47-aa28-4ed1-a173-ba7f4fcc2b31 tempest-VolumesExtendTest-1292949280 None] Lock "cinder-quobyte-9b4adaaa-bac8-4780-bc27-ecb3906a7f26" released by "delete_snapshot" :: held 2.301s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-19766c47-aa28-4ed1-a173-ba7f4fcc2b31 tempest-VolumesExtendTest-1292949280 None] Created reservations ['893cfa9c-7be3-4ce9-914a-99e131d3aaf1', '5b55813b-4c71-4ae1-8b24-b99134dded72', 'dc1cf50e-ff77-444c-a803-358ff2cf5735', '1b6a75aa-8a46-4f11-8aaa-67829539cf28'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:49:25 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67 1073741824" returned: 0 in 0.591s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:25 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-19766c47-aa28-4ed1-a173-ba7f4fcc2b31 tempest-VolumesExtendTest-1292949280 None] Delete snapshot completed successfully. Aug 27 03:49:25 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-19766c47-aa28-4ed1-a173-ba7f4fcc2b31 tempest-VolumesExtendTest-1292949280 None] Lock "cinder-0d359ee0-d927-46df-b8f8-110e5c97777d-delete_snapshot" released by "delete_snapshot" :: held 2.521s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:25 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67 Aug 27 03:49:25 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:26 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67" returned: 0 in 0.276s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:26 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:49:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643791d8-92e2-4f09-bdce-c4eff7e4bbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45962f14-99a7-400f-b18e-4a22194e6c67', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0c2409-9529-45b8-a29c-f0a2919b9735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:26 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Volume volume-45962f14-99a7-400f-b18e-4a22194e6c67 (45962f14-99a7-400f-b18e-4a22194e6c67): created successfully Aug 27 03:49:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0c2409-9529-45b8-a29c-f0a2919b9735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Flow 'volume_create_manager' (14d31b1a-b874-4fb0-a9d4-3fd06118ea41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:49:26 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e5117409-7ec5-47a1-9c28-38b9d7cd259a tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Created volume successfully. Aug 27 03:49:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d3e55ffe-3f61-4ace-b3f5-62f7c6a05221 tempest-VolumesExtendTest-1292949280 None] Acquiring lock "cinder-9b4adaaa-bac8-4780-bc27-ecb3906a7f26-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d3e55ffe-3f61-4ace-b3f5-62f7c6a05221 tempest-VolumesExtendTest-1292949280 None] Lock "cinder-9b4adaaa-bac8-4780-bc27-ecb3906a7f26-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d3e55ffe-3f61-4ace-b3f5-62f7c6a05221 tempest-VolumesExtendTest-1292949280 None] Acquiring lock "cinder-quobyte-9b4adaaa-bac8-4780-bc27-ecb3906a7f26" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d3e55ffe-3f61-4ace-b3f5-62f7c6a05221 tempest-VolumesExtendTest-1292949280 None] Lock "cinder-quobyte-9b4adaaa-bac8-4780-bc27-ecb3906a7f26" acquired by "delete_volume" :: waited 0.015s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:26 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f4018c-54cd-4f6f-9615-ce4cb713f33f]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:49:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d3e55ffe-3f61-4ace-b3f5-62f7c6a05221 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:26 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26 Aug 27 03:49:26 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:27 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d3e55ffe-3f61-4ace-b3f5-62f7c6a05221 tempest-VolumesExtendTest-1292949280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26" returned: 0 in 0.422s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d3e55ffe-3f61-4ace-b3f5-62f7c6a05221 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:27 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26 Aug 27 03:49:27 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ff5041b5-aae1-4901-bf07-ee6be6166cf1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ff5041b5-aae1-4901-bf07-ee6be6166cf1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-ff5041b5-aae1-4901-bf07-ee6be6166cf1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Creating offline snapshot bf75bec7-7447-428b-a996-649e351da1e2 of volume 45962f14-99a7-400f-b18e-4a22194e6c67 {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:49:27 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d79e00-ded7-4ee9-8897-537852884fc6]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:49:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ff5041b5-aae1-4901-bf07-ee6be6166cf1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:27 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67 Aug 27 03:49:27 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:27 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d3e55ffe-3f61-4ace-b3f5-62f7c6a05221 tempest-VolumesExtendTest-1292949280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9b4adaaa-bac8-4780-bc27-ecb3906a7f26" returned: 0 in 0.314s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:27 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d3e55ffe-3f61-4ace-b3f5-62f7c6a05221 tempest-VolumesExtendTest-1292949280 None] Lock "cinder-quobyte-9b4adaaa-bac8-4780-bc27-ecb3906a7f26" released by "delete_volume" :: held 0.807s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:27 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-d3e55ffe-3f61-4ace-b3f5-62f7c6a05221 tempest-VolumesExtendTest-1292949280 None] Created reservations ['9f5b907d-57aa-4a62-8602-ad05fa2bd03c', 'c6d01cd7-4fe3-4aee-8169-a1a734ea1fbf', '8d284bc8-f5e1-4671-9bbf-b1d0854e70fa', '087fdd0e-e60e-499f-8ae3-30f1e94837ac'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:49:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d3e55ffe-3f61-4ace-b3f5-62f7c6a05221 tempest-VolumesExtendTest-1292949280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d3e55ffe-3f61-4ace-b3f5-62f7c6a05221 tempest-VolumesExtendTest-1292949280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d3e55ffe-3f61-4ace-b3f5-62f7c6a05221 tempest-VolumesExtendTest-1292949280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:49:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d3e55ffe-3f61-4ace-b3f5-62f7c6a05221 tempest-VolumesExtendTest-1292949280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:49:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d3e55ffe-3f61-4ace-b3f5-62f7c6a05221 tempest-VolumesExtendTest-1292949280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d3e55ffe-3f61-4ace-b3f5-62f7c6a05221 tempest-VolumesExtendTest-1292949280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:27 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:49:27 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:27 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ff5041b5-aae1-4901-bf07-ee6be6166cf1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67" returned: 0 in 0.433s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ff5041b5-aae1-4901-bf07-ee6be6166cf1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.bf75bec7-7447-428b-a996-649e351da1e2 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:27 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.bf75bec7-7447-428b-a996-649e351da1e2 1G Aug 27 03:49:27 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:27 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d3e55ffe-3f61-4ace-b3f5-62f7c6a05221 tempest-VolumesExtendTest-1292949280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.305s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:27 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-d3e55ffe-3f61-4ace-b3f5-62f7c6a05221 tempest-VolumesExtendTest-1292949280 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:49:27 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d3e55ffe-3f61-4ace-b3f5-62f7c6a05221 tempest-VolumesExtendTest-1292949280 None] Deleted volume successfully. Aug 27 03:49:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d3e55ffe-3f61-4ace-b3f5-62f7c6a05221 tempest-VolumesExtendTest-1292949280 None] Lock "cinder-9b4adaaa-bac8-4780-bc27-ecb3906a7f26-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:28 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ff5041b5-aae1-4901-bf07-ee6be6166cf1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.bf75bec7-7447-428b-a996-649e351da1e2 1G" returned: 0 in 0.522s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ff5041b5-aae1-4901-bf07-ee6be6166cf1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45962f14-99a7-400f-b18e-4a22194e6c67 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.bf75bec7-7447-428b-a996-649e351da1e2 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:28 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45962f14-99a7-400f-b18e-4a22194e6c67 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.bf75bec7-7447-428b-a996-649e351da1e2 Aug 27 03:49:28 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:28 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ff5041b5-aae1-4901-bf07-ee6be6166cf1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45962f14-99a7-400f-b18e-4a22194e6c67 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.bf75bec7-7447-428b-a996-649e351da1e2" returned: 0 in 0.325s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:28 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-ff5041b5-aae1-4901-bf07-ee6be6166cf1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.bf75bec7-7447-428b-a996-649e351da1e2 is being set with open permissions: ugo+rw Aug 27 03:49:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ff5041b5-aae1-4901-bf07-ee6be6166cf1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.bf75bec7-7447-428b-a996-649e351da1e2 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:28 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.bf75bec7-7447-428b-a996-649e351da1e2 Aug 27 03:49:28 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:28 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ff5041b5-aae1-4901-bf07-ee6be6166cf1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.bf75bec7-7447-428b-a996-649e351da1e2" returned: 0 in 0.317s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ff5041b5-aae1-4901-bf07-ee6be6166cf1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:29 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.info Aug 27 03:49:29 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:29 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ff5041b5-aae1-4901-bf07-ee6be6166cf1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.info" returned: 0 in 0.326s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:29 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-ff5041b5-aae1-4901-bf07-ee6be6166cf1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.info is being set with open permissions: ugo+rw Aug 27 03:49:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ff5041b5-aae1-4901-bf07-ee6be6166cf1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:29 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.info Aug 27 03:49:29 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:29 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ff5041b5-aae1-4901-bf07-ee6be6166cf1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.info" returned: 0 in 0.280s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ff5041b5-aae1-4901-bf07-ee6be6166cf1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.339s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:29 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-ff5041b5-aae1-4901-bf07-ee6be6166cf1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Create snapshot completed successfully Aug 27 03:49:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3f7f1175-880c-4a03-88de-67f9ddae6a16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Acquiring lock "cinder-bf75bec7-7447-428b-a996-649e351da1e2-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3f7f1175-880c-4a03-88de-67f9ddae6a16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Lock "cinder-bf75bec7-7447-428b-a996-649e351da1e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3f7f1175-880c-4a03-88de-67f9ddae6a16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Acquiring lock "cinder-quobyte-45962f14-99a7-400f-b18e-4a22194e6c67" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3f7f1175-880c-4a03-88de-67f9ddae6a16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Lock "cinder-quobyte-45962f14-99a7-400f-b18e-4a22194e6c67" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3f7f1175-880c-4a03-88de-67f9ddae6a16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Acquiring lock "cinder-quobyte-bf75bec7-7447-428b-a996-649e351da1e2" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3f7f1175-880c-4a03-88de-67f9ddae6a16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Lock "cinder-quobyte-bf75bec7-7447-428b-a996-649e351da1e2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-3f7f1175-880c-4a03-88de-67f9ddae6a16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Deleting offline snapshot bf75bec7-7447-428b-a996-649e351da1e2 of volume 45962f14-99a7-400f-b18e-4a22194e6c67 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:49:31 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-3f7f1175-880c-4a03-88de-67f9ddae6a16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] snapshot_file for this snap is: volume-45962f14-99a7-400f-b18e-4a22194e6c67.bf75bec7-7447-428b-a996-649e351da1e2 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:49:31 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[d510ed26-bf82-4047-8e07-08b2973909b6]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:49:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3f7f1175-880c-4a03-88de-67f9ddae6a16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.bf75bec7-7447-428b-a996-649e351da1e2 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:31 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.bf75bec7-7447-428b-a996-649e351da1e2 Aug 27 03:49:31 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:31 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3f7f1175-880c-4a03-88de-67f9ddae6a16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.bf75bec7-7447-428b-a996-649e351da1e2" returned: 0 in 0.508s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:31 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-3f7f1175-880c-4a03-88de-67f9ddae6a16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45962f14-99a7-400f-b18e-4a22194e6c67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:49:31 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[24180585-aa24-461e-ac71-b90f50619205]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:49:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3f7f1175-880c-4a03-88de-67f9ddae6a16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:31 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67 Aug 27 03:49:31 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:32 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3f7f1175-880c-4a03-88de-67f9ddae6a16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67" returned: 0 in 0.435s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3f7f1175-880c-4a03-88de-67f9ddae6a16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.bf75bec7-7447-428b-a996-649e351da1e2 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:32 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.bf75bec7-7447-428b-a996-649e351da1e2 Aug 27 03:49:32 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:32 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3f7f1175-880c-4a03-88de-67f9ddae6a16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.bf75bec7-7447-428b-a996-649e351da1e2" returned: 0 in 0.454s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3f7f1175-880c-4a03-88de-67f9ddae6a16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.bf75bec7-7447-428b-a996-649e351da1e2 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:32 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.bf75bec7-7447-428b-a996-649e351da1e2 Aug 27 03:49:32 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:32 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3f7f1175-880c-4a03-88de-67f9ddae6a16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67.bf75bec7-7447-428b-a996-649e351da1e2" returned: 0 in 0.353s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:32 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=122,cinder:UPDATE=146,cinder:INSERT=36,cinder:DELETE=10 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:49:32 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=111,cinder:UPDATE=129,cinder:INSERT=38,cinder:DELETE=11 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:49:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3f7f1175-880c-4a03-88de-67f9ddae6a16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Lock "cinder-quobyte-bf75bec7-7447-428b-a996-649e351da1e2" released by "_delete_snapshot" :: held 1.903s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3f7f1175-880c-4a03-88de-67f9ddae6a16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Lock "cinder-quobyte-45962f14-99a7-400f-b18e-4a22194e6c67" released by "delete_snapshot" :: held 1.940s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:33 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-3f7f1175-880c-4a03-88de-67f9ddae6a16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Created reservations ['5200fe36-fe88-45d5-92a1-cb7e376e36d1', '7492a3cc-3632-4dbd-9769-372893cabb73', 'f3c1de4b-a752-41ba-b678-f3543f8e7e9e', 'eb736c71-7b8b-4278-8b08-1c581396f6c9'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:49:33 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-3f7f1175-880c-4a03-88de-67f9ddae6a16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Delete snapshot completed successfully. Aug 27 03:49:33 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3f7f1175-880c-4a03-88de-67f9ddae6a16 tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Lock "cinder-bf75bec7-7447-428b-a996-649e351da1e2-delete_snapshot" released by "delete_snapshot" :: held 2.162s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-42849d63-f835-4953-b17f-f1bb5b7d945d tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Acquiring lock "cinder-45962f14-99a7-400f-b18e-4a22194e6c67-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-42849d63-f835-4953-b17f-f1bb5b7d945d tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Lock "cinder-45962f14-99a7-400f-b18e-4a22194e6c67-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-42849d63-f835-4953-b17f-f1bb5b7d945d tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Acquiring lock "cinder-quobyte-45962f14-99a7-400f-b18e-4a22194e6c67" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-42849d63-f835-4953-b17f-f1bb5b7d945d tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Lock "cinder-quobyte-45962f14-99a7-400f-b18e-4a22194e6c67" acquired by "delete_volume" :: waited 0.019s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:34 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[733d2939-247c-49f7-9aed-9a14496c663c]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:49:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-42849d63-f835-4953-b17f-f1bb5b7d945d tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:34 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67 Aug 27 03:49:34 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:34 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-42849d63-f835-4953-b17f-f1bb5b7d945d tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67" returned: 0 in 0.396s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-42849d63-f835-4953-b17f-f1bb5b7d945d tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:34 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67 Aug 27 03:49:34 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:35 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-42849d63-f835-4953-b17f-f1bb5b7d945d tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45962f14-99a7-400f-b18e-4a22194e6c67" returned: 0 in 0.275s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:35 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-42849d63-f835-4953-b17f-f1bb5b7d945d tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Lock "cinder-quobyte-45962f14-99a7-400f-b18e-4a22194e6c67" released by "delete_volume" :: held 0.748s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:35 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-42849d63-f835-4953-b17f-f1bb5b7d945d tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Created reservations ['42a9fd4d-8d74-4183-b5e1-8bce32612ed0', 'afd966a2-7732-4c52-bc24-d6a845d59e84', 'ee242ba6-d4c8-45a5-92c0-eff036fae47d', '56f03e5d-2cd9-431c-82d9-69c1477e1a9e'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:49:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-42849d63-f835-4953-b17f-f1bb5b7d945d tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-42849d63-f835-4953-b17f-f1bb5b7d945d tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-42849d63-f835-4953-b17f-f1bb5b7d945d tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:49:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-42849d63-f835-4953-b17f-f1bb5b7d945d tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:49:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-42849d63-f835-4953-b17f-f1bb5b7d945d tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-42849d63-f835-4953-b17f-f1bb5b7d945d tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:35 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:49:35 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:35 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-42849d63-f835-4953-b17f-f1bb5b7d945d tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.370s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:35 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-42849d63-f835-4953-b17f-f1bb5b7d945d tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:49:35 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-42849d63-f835-4953-b17f-f1bb5b7d945d tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Deleted volume successfully. Aug 27 03:49:35 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-42849d63-f835-4953-b17f-f1bb5b7d945d tempest-VolumeSnapshotQuotasNegativeTestJSON-1542769624 None] Lock "cinder-45962f14-99a7-400f-b18e-4a22194e6c67-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Flow 'volume_create_manager' (44c2a168-25b2-4d9c-a9ed-7a637592190a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d829ad1a-5fd6-4855-8e16-ded9fa491908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d829ad1a-5fd6-4855-8e16-ded9fa491908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-875820880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2898e94-e3ad-490e-92ef-a5a6eed3da58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af683d5120c74da39759de8181f40eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:49:43Z,use_quota=True,user_id='979ff677d42b4827ba3e51db252d59af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ae6431-2d2c-4699-9747-7cde9d931133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ae6431-2d2c-4699-9747-7cde9d931133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b4e064-7faf-4c46-9972-c62b8b0614a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b4e064-7faf-4c46-9972-c62b8b0614a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2898e94-e3ad-490e-92ef-a5a6eed3da58', 'volume_name': 'volume-b2898e94-e3ad-490e-92ef-a5a6eed3da58', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed2eabe-c16e-4456-98e5-b65877b8eeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed2eabe-c16e-4456-98e5-b65877b8eeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e1d3e0-3a58-446e-b54e-f17bb27347ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:42 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Volume b2898e94-e3ad-490e-92ef-a5a6eed3da58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2898e94-e3ad-490e-92ef-a5a6eed3da58', 'volume_size': 1} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-875820880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2898e94-e3ad-490e-92ef-a5a6eed3da58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af683d5120c74da39759de8181f40eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:49:43Z,use_quota=True,user_id='979ff677d42b4827ba3e51db252d59af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Creating volume b2898e94-e3ad-490e-92ef-a5a6eed3da58 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:49:42 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2898e94-e3ad-490e-92ef-a5a6eed3da58 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:49:42 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2898e94-e3ad-490e-92ef-a5a6eed3da58 1073741824 Aug 27 03:49:42 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Flow 'volume_create_manager' (85366db0-5ced-4184-bd1a-7b5d8c1524b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c48882e-eab5-4478-a47d-12b7881908e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c48882e-eab5-4478-a47d-12b7881908e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-128534286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20adb79b-487f-4d5e-af5e-05328e2c5c6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983c4a98a134460ea1a6b9c2c63ae559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:49:43Z,use_quota=True,user_id='87c149b133bc476da1c8f28fe31dd267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8878af8e-524e-4d72-a221-9f3204850d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8878af8e-524e-4d72-a221-9f3204850d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7641b43-1209-4c0a-8bed-8c77a56c838b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7641b43-1209-4c0a-8bed-8c77a56c838b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20adb79b-487f-4d5e-af5e-05328e2c5c6d', 'volume_name': 'volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0549751-b476-4804-923f-9c8ddd73a510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0549751-b476-4804-923f-9c8ddd73a510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90df1930-e3fe-4738-b95e-903fa3ee3100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:42 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Volume 20adb79b-487f-4d5e-af5e-05328e2c5c6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d', 'volume_size': 1} Aug 27 03:49:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:43 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2898e94-e3ad-490e-92ef-a5a6eed3da58 1073741824" returned: 0 in 0.578s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2898e94-e3ad-490e-92ef-a5a6eed3da58 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:43 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2898e94-e3ad-490e-92ef-a5a6eed3da58 Aug 27 03:49:43 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:43 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2898e94-e3ad-490e-92ef-a5a6eed3da58" returned: 0 in 0.260s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:49:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.710s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-128534286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20adb79b-487f-4d5e-af5e-05328e2c5c6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983c4a98a134460ea1a6b9c2c63ae559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:49:43Z,use_quota=True,user_id='87c149b133bc476da1c8f28fe31dd267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:49:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Creating volume 20adb79b-487f-4d5e-af5e-05328e2c5c6d {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:49:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:49:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:49:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:49:43 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:49:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:43 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d 1073741824 Aug 27 03:49:43 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e1d3e0-3a58-446e-b54e-f17bb27347ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2898e94-e3ad-490e-92ef-a5a6eed3da58', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb478256-febb-4a84-aea8-a72a2cf8f25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:43 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Volume volume-b2898e94-e3ad-490e-92ef-a5a6eed3da58 (b2898e94-e3ad-490e-92ef-a5a6eed3da58): created successfully Aug 27 03:49:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb478256-febb-4a84-aea8-a72a2cf8f25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Flow 'volume_create_manager' (44c2a168-25b2-4d9c-a9ed-7a637592190a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:49:43 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-37514992-8353-4f96-aa91-3c2e260737b4 tempest-AbsoluteLimitsTests-463189143 None] Created volume successfully. Aug 27 03:49:44 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d 1073741824" returned: 0 in 0.438s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:44 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d Aug 27 03:49:44 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:44 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d" returned: 0 in 0.271s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:49:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90df1930-e3fe-4738-b95e-903fa3ee3100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0921f8ae-07eb-4355-b0b6-3a420344fd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:44 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Volume volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d (20adb79b-487f-4d5e-af5e-05328e2c5c6d): created successfully Aug 27 03:49:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0921f8ae-07eb-4355-b0b6-3a420344fd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Flow 'volume_create_manager' (85366db0-5ced-4184-bd1a-7b5d8c1524b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:49:44 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-1b6e35ec-a13d-46ac-b02a-72b8844ffc6b tempest-VolumesSnapshotTestJSON-311548116 None] Created volume successfully. Aug 27 03:49:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7fbe3b4d-41f8-40c3-a336-149c6716f939 tempest-AbsoluteLimitsTests-463189143 None] Acquiring lock "cinder-b2898e94-e3ad-490e-92ef-a5a6eed3da58-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7fbe3b4d-41f8-40c3-a336-149c6716f939 tempest-AbsoluteLimitsTests-463189143 None] Lock "cinder-b2898e94-e3ad-490e-92ef-a5a6eed3da58-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7fbe3b4d-41f8-40c3-a336-149c6716f939 tempest-AbsoluteLimitsTests-463189143 None] Acquiring lock "cinder-quobyte-b2898e94-e3ad-490e-92ef-a5a6eed3da58" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7fbe3b4d-41f8-40c3-a336-149c6716f939 tempest-AbsoluteLimitsTests-463189143 None] Lock "cinder-quobyte-b2898e94-e3ad-490e-92ef-a5a6eed3da58" acquired by "delete_volume" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:44 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6eb64fa-e4e6-4ae9-a108-e37eff734a8f]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:49:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7fbe3b4d-41f8-40c3-a336-149c6716f939 tempest-AbsoluteLimitsTests-463189143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2898e94-e3ad-490e-92ef-a5a6eed3da58 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:44 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2898e94-e3ad-490e-92ef-a5a6eed3da58 Aug 27 03:49:44 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:45 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7fbe3b4d-41f8-40c3-a336-149c6716f939 tempest-AbsoluteLimitsTests-463189143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2898e94-e3ad-490e-92ef-a5a6eed3da58" returned: 0 in 0.407s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7fbe3b4d-41f8-40c3-a336-149c6716f939 tempest-AbsoluteLimitsTests-463189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2898e94-e3ad-490e-92ef-a5a6eed3da58 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:45 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2898e94-e3ad-490e-92ef-a5a6eed3da58 Aug 27 03:49:45 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:45 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7fbe3b4d-41f8-40c3-a336-149c6716f939 tempest-AbsoluteLimitsTests-463189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2898e94-e3ad-490e-92ef-a5a6eed3da58" returned: 0 in 0.247s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7fbe3b4d-41f8-40c3-a336-149c6716f939 tempest-AbsoluteLimitsTests-463189143 None] Lock "cinder-quobyte-b2898e94-e3ad-490e-92ef-a5a6eed3da58" released by "delete_volume" :: held 0.701s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:45 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-7fbe3b4d-41f8-40c3-a336-149c6716f939 tempest-AbsoluteLimitsTests-463189143 None] Created reservations ['9813c85e-1bdb-47f1-af2a-f4d7fc85211e', '50d94b60-143c-4427-8a1a-7fb2885e3ee6', '603d7882-df5a-4395-8704-89a84c5f3f69', '10c564fa-969d-4fd7-8383-8861aa65b99c'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:49:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7fbe3b4d-41f8-40c3-a336-149c6716f939 tempest-AbsoluteLimitsTests-463189143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7fbe3b4d-41f8-40c3-a336-149c6716f939 tempest-AbsoluteLimitsTests-463189143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:45 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7fbe3b4d-41f8-40c3-a336-149c6716f939 tempest-AbsoluteLimitsTests-463189143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:49:45 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7fbe3b4d-41f8-40c3-a336-149c6716f939 tempest-AbsoluteLimitsTests-463189143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:49:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7fbe3b4d-41f8-40c3-a336-149c6716f939 tempest-AbsoluteLimitsTests-463189143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7fbe3b4d-41f8-40c3-a336-149c6716f939 tempest-AbsoluteLimitsTests-463189143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:45 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:49:45 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:45 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7fbe3b4d-41f8-40c3-a336-149c6716f939 tempest-AbsoluteLimitsTests-463189143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.315s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:45 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-7fbe3b4d-41f8-40c3-a336-149c6716f939 tempest-AbsoluteLimitsTests-463189143 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:49:45 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-7fbe3b4d-41f8-40c3-a336-149c6716f939 tempest-AbsoluteLimitsTests-463189143 None] Deleted volume successfully. Aug 27 03:49:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7fbe3b4d-41f8-40c3-a336-149c6716f939 tempest-AbsoluteLimitsTests-463189143 None] Lock "cinder-b2898e94-e3ad-490e-92ef-a5a6eed3da58-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-242beb4d-62e6-4fa2-a228-edc01fcc84cd tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-242beb4d-62e6-4fa2-a228-edc01fcc84cd tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:46 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-242beb4d-62e6-4fa2-a228-edc01fcc84cd tempest-VolumesSnapshotTestJSON-311548116 None] Creating offline snapshot 6074c715-2fb4-4204-af3b-7ad4af6e6276 of volume 20adb79b-487f-4d5e-af5e-05328e2c5c6d {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:49:46 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:49:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Flow 'volume_create_manager' (2e607b5e-2fbf-480f-8f33-b0a1bb716006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:49:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7fcb698-87d1-4d68-80a3-19e0dd526333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:46 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2907cf-57d2-4c73-8411-d4c68b838e8f]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:49:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-242beb4d-62e6-4fa2-a228-edc01fcc84cd tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7fcb698-87d1-4d68-80a3-19e0dd526333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-448042710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989ec92d-22b5-4bd1-8de2-229c7dce76cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a080f5fd50814d9288b8808d24eb0d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:49:46Z,use_quota=True,user_id='604f157b608d4ea1bf978b9f5456a4b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebe17f93-010f-49af-8be9-0d590ed88405),volume_type_id=ebe17f93-010f-49af-8be9-0d590ed88405)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d0e3e6-ad1f-435c-bb5e-bc8c5141c061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d0e3e6-ad1f-435c-bb5e-bc8c5141c061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e644dc-9c84-4692-b27a-b7d52ee3d980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e644dc-9c84-4692-b27a-b7d52ee3d980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '989ec92d-22b5-4bd1-8de2-229c7dce76cc', 'volume_name': 'volume-989ec92d-22b5-4bd1-8de2-229c7dce76cc', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb3f93d-cad9-4381-be47-0ea2692a1781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb3f93d-cad9-4381-be47-0ea2692a1781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:46 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f06c600-b5f2-4d09-a24b-af2c3dbb6511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:46 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Volume 989ec92d-22b5-4bd1-8de2-229c7dce76cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-989ec92d-22b5-4bd1-8de2-229c7dce76cc', 'volume_size': 1} Aug 27 03:49:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:46 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d Aug 27 03:49:46 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:46 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-242beb4d-62e6-4fa2-a228-edc01fcc84cd tempest-VolumesSnapshotTestJSON-311548116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d" returned: 0 in 0.417s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-242beb4d-62e6-4fa2-a228-edc01fcc84cd tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.6074c715-2fb4-4204-af3b-7ad4af6e6276 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:46 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.6074c715-2fb4-4204-af3b-7ad4af6e6276 1G Aug 27 03:49:46 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:47 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-242beb4d-62e6-4fa2-a228-edc01fcc84cd tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.6074c715-2fb4-4204-af3b-7ad4af6e6276 1G" returned: 0 in 0.474s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-242beb4d-62e6-4fa2-a228-edc01fcc84cd tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.6074c715-2fb4-4204-af3b-7ad4af6e6276 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:47 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.6074c715-2fb4-4204-af3b-7ad4af6e6276 Aug 27 03:49:47 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:47 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-242beb4d-62e6-4fa2-a228-edc01fcc84cd tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.6074c715-2fb4-4204-af3b-7ad4af6e6276" returned: 0 in 0.310s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:47 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-242beb4d-62e6-4fa2-a228-edc01fcc84cd tempest-VolumesSnapshotTestJSON-311548116 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.6074c715-2fb4-4204-af3b-7ad4af6e6276 is being set with open permissions: ugo+rw Aug 27 03:49:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-242beb4d-62e6-4fa2-a228-edc01fcc84cd tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.6074c715-2fb4-4204-af3b-7ad4af6e6276 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:47 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.6074c715-2fb4-4204-af3b-7ad4af6e6276 Aug 27 03:49:47 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:47 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-242beb4d-62e6-4fa2-a228-edc01fcc84cd tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.6074c715-2fb4-4204-af3b-7ad4af6e6276" returned: 0 in 0.292s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-242beb4d-62e6-4fa2-a228-edc01fcc84cd tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:47 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.info Aug 27 03:49:47 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:48 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-242beb4d-62e6-4fa2-a228-edc01fcc84cd tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.info" returned: 0 in 0.309s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:48 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-242beb4d-62e6-4fa2-a228-edc01fcc84cd tempest-VolumesSnapshotTestJSON-311548116 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.info is being set with open permissions: ugo+rw Aug 27 03:49:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-242beb4d-62e6-4fa2-a228-edc01fcc84cd tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:48 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.info Aug 27 03:49:48 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:48 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-242beb4d-62e6-4fa2-a228-edc01fcc84cd tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.info" returned: 0 in 0.270s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-242beb4d-62e6-4fa2-a228-edc01fcc84cd tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.200s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.066s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-448042710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989ec92d-22b5-4bd1-8de2-229c7dce76cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a080f5fd50814d9288b8808d24eb0d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:49:46Z,use_quota=True,user_id='604f157b608d4ea1bf978b9f5456a4b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebe17f93-010f-49af-8be9-0d590ed88405),volume_type_id=ebe17f93-010f-49af-8be9-0d590ed88405)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:49:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Creating volume 989ec92d-22b5-4bd1-8de2-229c7dce76cc {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:49:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:49:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:49:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:49:48 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:49:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-989ec92d-22b5-4bd1-8de2-229c7dce76cc 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:48 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-989ec92d-22b5-4bd1-8de2-229c7dce76cc 1073741824 Aug 27 03:49:48 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:48 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-242beb4d-62e6-4fa2-a228-edc01fcc84cd tempest-VolumesSnapshotTestJSON-311548116 None] Create snapshot completed successfully Aug 27 03:49:48 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-989ec92d-22b5-4bd1-8de2-229c7dce76cc 1073741824" returned: 0 in 0.497s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-989ec92d-22b5-4bd1-8de2-229c7dce76cc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:48 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-989ec92d-22b5-4bd1-8de2-229c7dce76cc Aug 27 03:49:48 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:49 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-989ec92d-22b5-4bd1-8de2-229c7dce76cc" returned: 0 in 0.287s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:49 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:49:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f06c600-b5f2-4d09-a24b-af2c3dbb6511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-989ec92d-22b5-4bd1-8de2-229c7dce76cc', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f477732-5666-439a-982d-a67b6905884c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:49 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Volume volume-989ec92d-22b5-4bd1-8de2-229c7dce76cc (989ec92d-22b5-4bd1-8de2-229c7dce76cc): created successfully Aug 27 03:49:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f477732-5666-439a-982d-a67b6905884c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Flow 'volume_create_manager' (2e607b5e-2fbf-480f-8f33-b0a1bb716006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:49:49 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-13f71a95-8ba9-47d0-a9d6-a09ef1d99eae tempest-VolumeTypesAccessTest-1491291406 None] Created volume successfully. Aug 27 03:49:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a8849a1b-d259-4353-b1f9-fa1cab768d64 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "cinder-6074c715-2fb4-4204-af3b-7ad4af6e6276-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a8849a1b-d259-4353-b1f9-fa1cab768d64 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-6074c715-2fb4-4204-af3b-7ad4af6e6276-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a8849a1b-d259-4353-b1f9-fa1cab768d64 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "cinder-quobyte-20adb79b-487f-4d5e-af5e-05328e2c5c6d" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a8849a1b-d259-4353-b1f9-fa1cab768d64 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-20adb79b-487f-4d5e-af5e-05328e2c5c6d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a8849a1b-d259-4353-b1f9-fa1cab768d64 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "cinder-quobyte-6074c715-2fb4-4204-af3b-7ad4af6e6276" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a8849a1b-d259-4353-b1f9-fa1cab768d64 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-6074c715-2fb4-4204-af3b-7ad4af6e6276" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:49 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-a8849a1b-d259-4353-b1f9-fa1cab768d64 tempest-VolumesSnapshotTestJSON-311548116 None] Deleting offline snapshot 6074c715-2fb4-4204-af3b-7ad4af6e6276 of volume 20adb79b-487f-4d5e-af5e-05328e2c5c6d {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:49:49 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-a8849a1b-d259-4353-b1f9-fa1cab768d64 tempest-VolumesSnapshotTestJSON-311548116 None] snapshot_file for this snap is: volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.6074c715-2fb4-4204-af3b-7ad4af6e6276 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:49:49 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b5585d-8b16-4ae8-9e2e-ee7c3cd12bb0]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:49:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a8849a1b-d259-4353-b1f9-fa1cab768d64 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.6074c715-2fb4-4204-af3b-7ad4af6e6276 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:49 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.6074c715-2fb4-4204-af3b-7ad4af6e6276 Aug 27 03:49:49 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:49 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a8849a1b-d259-4353-b1f9-fa1cab768d64 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.6074c715-2fb4-4204-af3b-7ad4af6e6276" returned: 0 in 0.366s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:49 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-a8849a1b-d259-4353-b1f9-fa1cab768d64 tempest-VolumesSnapshotTestJSON-311548116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:49:49 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fa06c2-a0d8-47be-8677-fc7ce1f3392a]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:49:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a8849a1b-d259-4353-b1f9-fa1cab768d64 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:49 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d Aug 27 03:49:49 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:50 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a8849a1b-d259-4353-b1f9-fa1cab768d64 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d" returned: 0 in 0.431s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a8849a1b-d259-4353-b1f9-fa1cab768d64 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.6074c715-2fb4-4204-af3b-7ad4af6e6276 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:50 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.6074c715-2fb4-4204-af3b-7ad4af6e6276 Aug 27 03:49:50 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Flow 'volume_create_manager' (8ec9ec27-a90a-4878-ad6c-ced7faeb6724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3d9e4f-8b3e-47d1-bdcb-8dc02af4649d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3d9e4f-8b3e-47d1-bdcb-8dc02af4649d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1540345536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e186af7-6126-4fc1-b90a-92c081169ec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6fef6749d734484ae8dfcdf2394c3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:49:50Z,use_quota=True,user_id='6fd30fa731e14134b3fe8c0f790264a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (932b7505-582c-41b6-9663-49bc34e08e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (932b7505-582c-41b6-9663-49bc34e08e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c66214-ce86-4415-b97d-b4f7fba5a34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c66214-ce86-4415-b97d-b4f7fba5a34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e186af7-6126-4fc1-b90a-92c081169ec9', 'volume_name': 'volume-9e186af7-6126-4fc1-b90a-92c081169ec9', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9a3bd1-a9ee-4aae-8025-67d22e4d99b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9a3bd1-a9ee-4aae-8025-67d22e4d99b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca57879-5adb-4c9c-944f-e0afbfa1984c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:50 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Volume 9e186af7-6126-4fc1-b90a-92c081169ec9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e186af7-6126-4fc1-b90a-92c081169ec9', 'volume_size': 1} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1540345536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e186af7-6126-4fc1-b90a-92c081169ec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6fef6749d734484ae8dfcdf2394c3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:49:50Z,use_quota=True,user_id='6fd30fa731e14134b3fe8c0f790264a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Creating volume 9e186af7-6126-4fc1-b90a-92c081169ec9 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:49:50 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:50 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9 1073741824 Aug 27 03:49:50 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:50 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a8849a1b-d259-4353-b1f9-fa1cab768d64 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.6074c715-2fb4-4204-af3b-7ad4af6e6276" returned: 0 in 0.391s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a8849a1b-d259-4353-b1f9-fa1cab768d64 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.6074c715-2fb4-4204-af3b-7ad4af6e6276 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b122ba84-95be-418a-80d8-6af86e84283d tempest-VolumeTypesAccessTest-1491291406 None] Acquiring lock "cinder-989ec92d-22b5-4bd1-8de2-229c7dce76cc-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:50 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.6074c715-2fb4-4204-af3b-7ad4af6e6276 Aug 27 03:49:50 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b122ba84-95be-418a-80d8-6af86e84283d tempest-VolumeTypesAccessTest-1491291406 None] Lock "cinder-989ec92d-22b5-4bd1-8de2-229c7dce76cc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b122ba84-95be-418a-80d8-6af86e84283d tempest-VolumeTypesAccessTest-1491291406 None] Acquiring lock "cinder-quobyte-989ec92d-22b5-4bd1-8de2-229c7dce76cc" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b122ba84-95be-418a-80d8-6af86e84283d tempest-VolumeTypesAccessTest-1491291406 None] Lock "cinder-quobyte-989ec92d-22b5-4bd1-8de2-229c7dce76cc" acquired by "delete_volume" :: waited 0.015s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[66be15d1-c192-4c60-a72c-3d4264623823]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b122ba84-95be-418a-80d8-6af86e84283d tempest-VolumeTypesAccessTest-1491291406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-989ec92d-22b5-4bd1-8de2-229c7dce76cc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:50 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-989ec92d-22b5-4bd1-8de2-229c7dce76cc Aug 27 03:49:50 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:50 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9 1073741824" returned: 0 in 0.507s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:50 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a8849a1b-d259-4353-b1f9-fa1cab768d64 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d.6074c715-2fb4-4204-af3b-7ad4af6e6276" returned: 0 in 0.333s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a8849a1b-d259-4353-b1f9-fa1cab768d64 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-6074c715-2fb4-4204-af3b-7ad4af6e6276" released by "_delete_snapshot" :: held 1.645s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a8849a1b-d259-4353-b1f9-fa1cab768d64 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-20adb79b-487f-4d5e-af5e-05328e2c5c6d" released by "delete_snapshot" :: held 1.684s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:51 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9 Aug 27 03:49:51 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-a8849a1b-d259-4353-b1f9-fa1cab768d64 tempest-VolumesSnapshotTestJSON-311548116 None] Created reservations ['71472e62-7378-4d93-8c49-69e0033b12fc', '7bee5c41-52af-4417-a2c4-42592263069c', '47a56ec9-af1a-4076-8c34-3487ddbcae59', '3f9e6242-5fb8-4de3-bef9-7e4ff1ca1870'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:49:51 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-a8849a1b-d259-4353-b1f9-fa1cab768d64 tempest-VolumesSnapshotTestJSON-311548116 None] Delete snapshot completed successfully. Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a8849a1b-d259-4353-b1f9-fa1cab768d64 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-6074c715-2fb4-4204-af3b-7ad4af6e6276-delete_snapshot" released by "delete_snapshot" :: held 1.870s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:51 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b122ba84-95be-418a-80d8-6af86e84283d tempest-VolumeTypesAccessTest-1491291406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-989ec92d-22b5-4bd1-8de2-229c7dce76cc" returned: 0 in 0.427s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b122ba84-95be-418a-80d8-6af86e84283d tempest-VolumeTypesAccessTest-1491291406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-989ec92d-22b5-4bd1-8de2-229c7dce76cc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:51 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-989ec92d-22b5-4bd1-8de2-229c7dce76cc Aug 27 03:49:51 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:51 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9" returned: 0 in 0.283s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca57879-5adb-4c9c-944f-e0afbfa1984c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e186af7-6126-4fc1-b90a-92c081169ec9', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f378a49d-c40a-4185-97a1-c90a495ae5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:51 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Volume volume-9e186af7-6126-4fc1-b90a-92c081169ec9 (9e186af7-6126-4fc1-b90a-92c081169ec9): created successfully Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f378a49d-c40a-4185-97a1-c90a495ae5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Flow 'volume_create_manager' (8ec9ec27-a90a-4878-ad6c-ced7faeb6724) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:49:51 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-2d75c60f-7291-4e99-a8c3-a9c20f2b79e9 tempest-VolumesDeleteCascade-1695356368 None] Created volume successfully. Aug 27 03:49:51 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b122ba84-95be-418a-80d8-6af86e84283d tempest-VolumeTypesAccessTest-1491291406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-989ec92d-22b5-4bd1-8de2-229c7dce76cc" returned: 0 in 0.273s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b122ba84-95be-418a-80d8-6af86e84283d tempest-VolumeTypesAccessTest-1491291406 None] Lock "cinder-quobyte-989ec92d-22b5-4bd1-8de2-229c7dce76cc" released by "delete_volume" :: held 0.743s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:51 devstack cinder-volume[94328]: WARNING cinder.quota [None req-b122ba84-95be-418a-80d8-6af86e84283d tempest-VolumeTypesAccessTest-1491291406 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1004367395 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1004367395, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:49:51 devstack cinder-volume[94328]: WARNING cinder.quota [None req-b122ba84-95be-418a-80d8-6af86e84283d tempest-VolumeTypesAccessTest-1491291406 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1004367395 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1004367395, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-b122ba84-95be-418a-80d8-6af86e84283d tempest-VolumeTypesAccessTest-1491291406 None] Created reservations ['59048776-6a61-4f0c-992e-fd9e4d494a79', 'd04fa91e-326f-46f2-8650-cab28808a59e', 'cedf8b83-fadf-414c-b561-fca7c84c5397', '0cef3574-1e9c-4613-aeaa-3f03aa83d223'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b122ba84-95be-418a-80d8-6af86e84283d tempest-VolumeTypesAccessTest-1491291406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b122ba84-95be-418a-80d8-6af86e84283d tempest-VolumeTypesAccessTest-1491291406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b122ba84-95be-418a-80d8-6af86e84283d tempest-VolumeTypesAccessTest-1491291406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b122ba84-95be-418a-80d8-6af86e84283d tempest-VolumeTypesAccessTest-1491291406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b122ba84-95be-418a-80d8-6af86e84283d tempest-VolumeTypesAccessTest-1491291406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b122ba84-95be-418a-80d8-6af86e84283d tempest-VolumeTypesAccessTest-1491291406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:51 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:49:51 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:51 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b122ba84-95be-418a-80d8-6af86e84283d tempest-VolumeTypesAccessTest-1491291406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.309s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:51 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-b122ba84-95be-418a-80d8-6af86e84283d tempest-VolumeTypesAccessTest-1491291406 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:49:51 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-b122ba84-95be-418a-80d8-6af86e84283d tempest-VolumeTypesAccessTest-1491291406 None] Deleted volume successfully. Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b122ba84-95be-418a-80d8-6af86e84283d tempest-VolumeTypesAccessTest-1491291406 None] Lock "cinder-989ec92d-22b5-4bd1-8de2-229c7dce76cc-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Flow 'volume_create_manager' (5138a63f-659c-4ac4-8ae7-4273360e15bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1df6f8b-b902-45b8-8f07-00b83183fe8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1df6f8b-b902-45b8-8f07-00b83183fe8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2034923577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cab9f0a-e1a2-49db-9bfc-06e680e9a409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983c4a98a134460ea1a6b9c2c63ae559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:49:52Z,use_quota=True,user_id='87c149b133bc476da1c8f28fe31dd267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fb5869-439b-4c3a-9dd9-7f5c2d91f0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fb5869-439b-4c3a-9dd9-7f5c2d91f0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f775f68-e9f9-4000-832e-b9310274db3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f775f68-e9f9-4000-832e-b9310274db3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cab9f0a-e1a2-49db-9bfc-06e680e9a409', 'volume_name': 'volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8289bbf4-da3c-4821-b369-e450d447c96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8289bbf4-da3c-4821-b369-e450d447c96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341662f2-f6fe-4243-86ab-93010fefde40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:52 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Volume 2cab9f0a-e1a2-49db-9bfc-06e680e9a409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409', 'volume_size': 1} Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2034923577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cab9f0a-e1a2-49db-9bfc-06e680e9a409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983c4a98a134460ea1a6b9c2c63ae559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:49:52Z,use_quota=True,user_id='87c149b133bc476da1c8f28fe31dd267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Creating volume 2cab9f0a-e1a2-49db-9bfc-06e680e9a409 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:49:52 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:52 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409 1073741824 Aug 27 03:49:52 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a66db338-21cf-4f6b-bb0c-86592c70660f tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:52 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409 1073741824" returned: 0 in 0.524s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:52 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409 Aug 27 03:49:52 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:53 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409" returned: 0 in 0.284s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:49:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a66db338-21cf-4f6b-bb0c-86592c70660f tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.422s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341662f2-f6fe-4243-86ab-93010fefde40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4af4c4-def0-404e-bfd6-85fb5da800ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-a66db338-21cf-4f6b-bb0c-86592c70660f tempest-VolumesDeleteCascade-1695356368 None] Creating offline snapshot 6c8165e9-f271-4970-9183-c325807ed977 of volume 9e186af7-6126-4fc1-b90a-92c081169ec9 {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:49:53 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Volume volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409 (2cab9f0a-e1a2-49db-9bfc-06e680e9a409): created successfully Aug 27 03:49:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4af4c4-def0-404e-bfd6-85fb5da800ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Flow 'volume_create_manager' (5138a63f-659c-4ac4-8ae7-4273360e15bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:49:53 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04fe439-a8cd-4e3d-bfa7-96a98abbcadc]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:49:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a66db338-21cf-4f6b-bb0c-86592c70660f tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:53 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-a9b2ed25-c414-43d0-897e-8d1b5e90663c tempest-VolumesSnapshotTestJSON-311548116 None] Created volume successfully. Aug 27 03:49:53 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9 Aug 27 03:49:53 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:53 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a66db338-21cf-4f6b-bb0c-86592c70660f tempest-VolumesDeleteCascade-1695356368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9" returned: 0 in 0.386s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a66db338-21cf-4f6b-bb0c-86592c70660f tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:53 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977 1G Aug 27 03:49:53 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:54 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a66db338-21cf-4f6b-bb0c-86592c70660f tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977 1G" returned: 0 in 0.481s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a66db338-21cf-4f6b-bb0c-86592c70660f tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e186af7-6126-4fc1-b90a-92c081169ec9 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:54 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e186af7-6126-4fc1-b90a-92c081169ec9 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977 Aug 27 03:49:54 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:54 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a66db338-21cf-4f6b-bb0c-86592c70660f tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e186af7-6126-4fc1-b90a-92c081169ec9 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977" returned: 0 in 0.362s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:54 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-a66db338-21cf-4f6b-bb0c-86592c70660f tempest-VolumesDeleteCascade-1695356368 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977 is being set with open permissions: ugo+rw Aug 27 03:49:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a66db338-21cf-4f6b-bb0c-86592c70660f tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-62d59c77-aa11-4872-bdf5-2ee057b71982 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:54 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977 Aug 27 03:49:54 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:54 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a66db338-21cf-4f6b-bb0c-86592c70660f tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977" returned: 0 in 0.274s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a66db338-21cf-4f6b-bb0c-86592c70660f tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:54 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.info Aug 27 03:49:54 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:55 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a66db338-21cf-4f6b-bb0c-86592c70660f tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.info" returned: 0 in 0.309s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:55 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-a66db338-21cf-4f6b-bb0c-86592c70660f tempest-VolumesDeleteCascade-1695356368 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.info is being set with open permissions: ugo+rw Aug 27 03:49:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a66db338-21cf-4f6b-bb0c-86592c70660f tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:55 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.info Aug 27 03:49:55 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:55 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a66db338-21cf-4f6b-bb0c-86592c70660f tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.info" returned: 0 in 0.280s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a66db338-21cf-4f6b-bb0c-86592c70660f tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.241s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-62d59c77-aa11-4872-bdf5-2ee057b71982 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.932s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-62d59c77-aa11-4872-bdf5-2ee057b71982 tempest-VolumesSnapshotTestJSON-311548116 None] Creating offline snapshot eed011b0-398e-4672-a829-24ef815c9a77 of volume 2cab9f0a-e1a2-49db-9bfc-06e680e9a409 {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:49:55 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-a66db338-21cf-4f6b-bb0c-86592c70660f tempest-VolumesDeleteCascade-1695356368 None] Create snapshot completed successfully Aug 27 03:49:55 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[867d5179-d8b2-4ad4-9d22-c9bd440d2dc0]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:49:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-62d59c77-aa11-4872-bdf5-2ee057b71982 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:55 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409 Aug 27 03:49:55 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:55 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-62d59c77-aa11-4872-bdf5-2ee057b71982 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409" returned: 0 in 0.551s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-62d59c77-aa11-4872-bdf5-2ee057b71982 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.eed011b0-398e-4672-a829-24ef815c9a77 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:56 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.eed011b0-398e-4672-a829-24ef815c9a77 1G Aug 27 03:49:56 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-d6ec808f-df59-4975-9a0b-2ef547c55893 req-85133476-600d-4f74-bf88-2436b4199191 tempest-TestStampPattern-1729760105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f939adee-1757-420d-8ba1-a6ae278e80dc tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:56 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-62d59c77-aa11-4872-bdf5-2ee057b71982 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.eed011b0-398e-4672-a829-24ef815c9a77 1G" returned: 0 in 0.503s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-62d59c77-aa11-4872-bdf5-2ee057b71982 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.eed011b0-398e-4672-a829-24ef815c9a77 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:56 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.eed011b0-398e-4672-a829-24ef815c9a77 Aug 27 03:49:56 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:56 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-62d59c77-aa11-4872-bdf5-2ee057b71982 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.eed011b0-398e-4672-a829-24ef815c9a77" returned: 0 in 0.360s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:56 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-62d59c77-aa11-4872-bdf5-2ee057b71982 tempest-VolumesSnapshotTestJSON-311548116 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.eed011b0-398e-4672-a829-24ef815c9a77 is being set with open permissions: ugo+rw Aug 27 03:49:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-62d59c77-aa11-4872-bdf5-2ee057b71982 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.eed011b0-398e-4672-a829-24ef815c9a77 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:56 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.eed011b0-398e-4672-a829-24ef815c9a77 Aug 27 03:49:56 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:57 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-62d59c77-aa11-4872-bdf5-2ee057b71982 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.eed011b0-398e-4672-a829-24ef815c9a77" returned: 0 in 0.288s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-62d59c77-aa11-4872-bdf5-2ee057b71982 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:57 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.info Aug 27 03:49:57 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:57 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-62d59c77-aa11-4872-bdf5-2ee057b71982 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.info" returned: 0 in 0.268s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:57 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-62d59c77-aa11-4872-bdf5-2ee057b71982 tempest-VolumesSnapshotTestJSON-311548116 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.info is being set with open permissions: ugo+rw Aug 27 03:49:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-62d59c77-aa11-4872-bdf5-2ee057b71982 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:57 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.info Aug 27 03:49:57 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:57 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-62d59c77-aa11-4872-bdf5-2ee057b71982 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.info" returned: 0 in 0.258s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-62d59c77-aa11-4872-bdf5-2ee057b71982 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.373s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-d6ec808f-df59-4975-9a0b-2ef547c55893 req-85133476-600d-4f74-bf88-2436b4199191 tempest-TestStampPattern-1729760105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.613s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-d6ec808f-df59-4975-9a0b-2ef547c55893 req-85133476-600d-4f74-bf88-2436b4199191 tempest-TestStampPattern-1729760105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f939adee-1757-420d-8ba1-a6ae278e80dc tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.631s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:57 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-62d59c77-aa11-4872-bdf5-2ee057b71982 tempest-VolumesSnapshotTestJSON-311548116 None] Create snapshot completed successfully Aug 27 03:49:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-f939adee-1757-420d-8ba1-a6ae278e80dc tempest-VolumesDeleteCascade-1695356368 None] Creating offline snapshot e7bf3f5f-e79c-4a95-a3e3-abf185557b4e of volume 9e186af7-6126-4fc1-b90a-92c081169ec9 {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:49:57 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4e2a34-138e-495f-b8aa-584d1d8babb1]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:49:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f939adee-1757-420d-8ba1-a6ae278e80dc tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-d6ec808f-df59-4975-9a0b-2ef547c55893 req-85133476-600d-4f74-bf88-2436b4199191 tempest-TestStampPattern-1729760105 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac', 'name': 'volume-0d2094e3-8104-41d8-a618-8f864841069c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb5ab67d-00b6-47cc-baa2-254bfbc69eab', 'enforce_multipath': True} {{(pid=94328) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 27 03:49:57 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-d6ec808f-df59-4975-9a0b-2ef547c55893 req-85133476-600d-4f74-bf88-2436b4199191 tempest-TestStampPattern-1729760105 None] attachment_update completed successfully. Aug 27 03:49:57 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977 Aug 27 03:49:57 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:58 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f939adee-1757-420d-8ba1-a6ae278e80dc tempest-VolumesDeleteCascade-1695356368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977" returned: 0 in 0.517s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-f939adee-1757-420d-8ba1-a6ae278e80dc tempest-VolumesDeleteCascade-1695356368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e186af7-6126-4fc1-b90a-92c081169ec9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:49:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f939adee-1757-420d-8ba1-a6ae278e80dc tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:58 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e 1G Aug 27 03:49:58 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:59 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f939adee-1757-420d-8ba1-a6ae278e80dc tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e 1G" returned: 0 in 0.665s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f939adee-1757-420d-8ba1-a6ae278e80dc tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:59 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e Aug 27 03:49:59 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Flow 'volume_create_manager' (15fc27cc-ce0a-40c4-a301-6f348c1b8bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63aa1877-1917-47c0-98b3-830054803d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63aa1877-1917-47c0-98b3-830054803d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1356379018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04007f08-7bde-4197-befe-f24e3021928c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983c4a98a134460ea1a6b9c2c63ae559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:49:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=eed011b0-398e-4672-a829-24ef815c9a77,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:49:59Z,use_quota=True,user_id='87c149b133bc476da1c8f28fe31dd267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6825fc-8736-43c3-b2d0-461b48e480f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6825fc-8736-43c3-b2d0-461b48e480f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f49b20-a27d-4e65-af08-e9995dfb5e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f49b20-a27d-4e65-af08-e9995dfb5e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '04007f08-7bde-4197-befe-f24e3021928c', 'volume_name': 'volume-04007f08-7bde-4197-befe-f24e3021928c', 'volume_size': 2, 'snapshot_id': 'eed011b0-398e-4672-a829-24ef815c9a77'}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c7efb1-2d96-4097-a3d3-86602bc3c34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c7efb1-2d96-4097-a3d3-86602bc3c34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c269c3b-5869-422c-ac80-ec23508152d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:49:59 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Volume 04007f08-7bde-4197-befe-f24e3021928c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-04007f08-7bde-4197-befe-f24e3021928c', 'volume_size': 2, 'snapshot_id': 'eed011b0-398e-4672-a829-24ef815c9a77'} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:59 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f939adee-1757-420d-8ba1-a6ae278e80dc tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e" returned: 0 in 0.396s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:59 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-f939adee-1757-420d-8ba1-a6ae278e80dc tempest-VolumesDeleteCascade-1695356368 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e is being set with open permissions: ugo+rw Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f939adee-1757-420d-8ba1-a6ae278e80dc tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:59 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e Aug 27 03:49:59 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:49:59 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f939adee-1757-420d-8ba1-a6ae278e80dc tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e" returned: 0 in 0.258s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f939adee-1757-420d-8ba1-a6ae278e80dc tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.956s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.300s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "cinder-quobyte-eed011b0-398e-4672-a829-24ef815c9a77-04007f08-7bde-4197-befe-f24e3021928c" by "_create_volume_from_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-eed011b0-398e-4672-a829-24ef815c9a77-04007f08-7bde-4197-befe-f24e3021928c" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Creating volume 04007f08-7bde-4197-befe-f24e3021928c from snapshot eed011b0-398e-4672-a829-24ef815c9a77 {{(pid=94328) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "cinder-quobyte-04007f08-7bde-4197-befe-f24e3021928c" by "_copy_volume_from_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:49:59 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f939adee-1757-420d-8ba1-a6ae278e80dc tempest-VolumesDeleteCascade-1695356368 None] Create snapshot completed successfully Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-04007f08-7bde-4197-befe-f24e3021928c" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] snapshot: eed011b0-398e-4672-a829-24ef815c9a77, volume: 04007f08-7bde-4197-befe-f24e3021928c, {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2211f6-98db-47b8-81bb-1e9071e0be28]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:49:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.eed011b0-398e-4672-a829-24ef815c9a77 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:49:59 devstack sudo[108350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.eed011b0-398e-4672-a829-24ef815c9a77 Aug 27 03:49:59 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:00 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.eed011b0-398e-4672-a829-24ef815c9a77" returned: 0 in 0.401s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bed9b4-1f70-4be9-912c-560245a87892]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:00 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409 Aug 27 03:50:00 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "cinder-9e186af7-6126-4fc1-b90a-92c081169ec9-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-9e186af7-6126-4fc1-b90a-92c081169ec9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Performing cascade delete. {{(pid=94328) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "cinder-6c8165e9-f271-4970-9183-c325807ed977-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-6c8165e9-f271-4970-9183-c325807ed977-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "cinder-quobyte-9e186af7-6126-4fc1-b90a-92c081169ec9" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-quobyte-9e186af7-6126-4fc1-b90a-92c081169ec9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "cinder-quobyte-6c8165e9-f271-4970-9183-c325807ed977" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-quobyte-6c8165e9-f271-4970-9183-c325807ed977" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Deleting offline snapshot 6c8165e9-f271-4970-9183-c325807ed977 of volume 9e186af7-6126-4fc1-b90a-92c081169ec9 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] snapshot_file for this snap is: volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e3d3cf-2bd7-4a9c-973f-3871a25f6d4f]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Flow 'volume_create_manager' (4d14059f-65aa-4c4a-ab75-7fcfabf994c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22c9621-aaee-44dd-8b33-98f7be99c2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22c9621-aaee-44dd-8b33-98f7be99c2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1462141301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4859f7fd4a9e40d2972eb5cb48ae9546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:50:01Z,use_quota=True,user_id='d72348d811944b68a40e9fb41246394f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (265c6af0-db84-4648-9e8a-9426b0c59137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (265c6af0-db84-4648-9e8a-9426b0c59137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:00 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52d4a923-77a0-4919-bd52-ea1bcc02ac1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52d4a923-77a0-4919-bd52-ea1bcc02ac1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5', 'volume_name': 'volume-0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4f65e9-ca84-4f88-9456-5280dd7257f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4f65e9-ca84-4f88-9456-5280dd7257f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84614120-c1c8-47b9-a7f1-2ab8082528b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:00 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Volume 0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5', 'volume_size': 1} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409" returned: 0 in 0.532s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] will copy from snapshot at /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409 {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Creating direct copy from snapshot {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG cinder.utils [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Path /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04007f08-7bde-4197-befe-f24e3021928c not found in is_blk_device check {{(pid=94328) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 27 03:50:00 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977 Aug 27 03:50:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04007f08-7bde-4197-befe-f24e3021928c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:00 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:00 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04007f08-7bde-4197-befe-f24e3021928c Aug 27 03:50:00 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:01 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977" returned: 0 in 0.396s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e186af7-6126-4fc1-b90a-92c081169ec9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:50:01 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab0fa8f-17ab-4414-b967-3d19c72619de]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:01 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9 Aug 27 03:50:01 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:01 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9" returned: 0 in 0.707s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:01 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06bf44f-e666-4441-b3d6-40d39ec8567b]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:02 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e Aug 27 03:50:02 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:02 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-ce0550e7-4b77-45aa-9de7-b2b38e047cd2 req-8f1f3579-6bf1-4c05-ab3e-28109f9c8f0e tempest-TestStampPattern-1729760105 None] Terminate volume connection completed successfully. Aug 27 03:50:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-ce0550e7-4b77-45aa-9de7-b2b38e047cd2 req-8f1f3579-6bf1-4c05-ab3e-28109f9c8f0e tempest-TestStampPattern-1729760105 None] Deleting attachment cb5ab67d-00b6-47cc-baa2-254bfbc69eab. {{(pid=94328) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 27 03:50:02 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e" returned: 0 in 0.890s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:02 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e186af7-6126-4fc1-b90a-92c081169ec9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:50:02 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cad053-6012-4064-8151-7034496438f8]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:03 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977 Aug 27 03:50:03 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:03 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977" returned: 0 in 0.669s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:03 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e186af7-6126-4fc1-b90a-92c081169ec9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:50:03 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ec3506-28b4-49d3-ae59-e3bb3c5e21a0]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:03 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9 Aug 27 03:50:03 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:04 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9" returned: 0 in 0.990s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:04 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977 Aug 27 03:50:04 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:05 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977" returned: 0 in 1.065s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:05 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977 Aug 27 03:50:05 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:06 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.6c8165e9-f271-4970-9183-c325807ed977" returned: 0 in 0.810s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e186af7-6126-4fc1-b90a-92c081169ec9 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e -F qcow2 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:06 devstack sudo[108467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e186af7-6126-4fc1-b90a-92c081169ec9 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e -F qcow2 Aug 27 03:50:06 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:06 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04007f08-7bde-4197-befe-f24e3021928c" returned: 0 in 5.807s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:06 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Image conversion details: src /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409, size 1024.00 MB, duration 5.81 sec, destination /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04007f08-7bde-4197-befe-f24e3021928c {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:50:06 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Converted 1024.00 MB image at 176.28 MB/s Aug 27 03:50:06 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04007f08-7bde-4197-befe-f24e3021928c is being set with open permissions: ugo+rw Aug 27 03:50:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04007f08-7bde-4197-befe-f24e3021928c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:06 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04007f08-7bde-4197-befe-f24e3021928c Aug 27 03:50:06 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:06 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04007f08-7bde-4197-befe-f24e3021928c" returned: 0 in 0.404s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-04007f08-7bde-4197-befe-f24e3021928c" released by "_copy_volume_from_snapshot" :: held 7.257s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:07 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e186af7-6126-4fc1-b90a-92c081169ec9 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e -F qcow2" returned: 0 in 0.601s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-quobyte-6c8165e9-f271-4970-9183-c325807ed977" released by "_delete_snapshot" :: held 6.469s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-quobyte-9e186af7-6126-4fc1-b90a-92c081169ec9" released by "delete_snapshot" :: held 6.508s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-eed011b0-398e-4672-a829-24ef815c9a77-04007f08-7bde-4197-befe-f24e3021928c" released by "_create_volume_from_snapshot" :: held 7.420s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.448s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.382s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1462141301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4859f7fd4a9e40d2972eb5cb48ae9546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:50:01Z,use_quota=True,user_id='d72348d811944b68a40e9fb41246394f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Creating volume 0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:50:07 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:07 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5 1073741824 Aug 27 03:50:07 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c269c3b-5869-422c-ac80-ec23508152d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04007f08-7bde-4197-befe-f24e3021928c', 'volume_size': 2, 'snapshot_id': 'eed011b0-398e-4672-a829-24ef815c9a77'}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6217f27-c5b7-4e72-9d2a-1dfeb6ea0937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:07 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Volume volume-04007f08-7bde-4197-befe-f24e3021928c (04007f08-7bde-4197-befe-f24e3021928c): created successfully Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6217f27-c5b7-4e72-9d2a-1dfeb6ea0937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Flow 'volume_create_manager' (15fc27cc-ce0a-40c4-a301-6f348c1b8bca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:50:07 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-7cfbed37-0243-47a4-9914-d1d17b0a8780 tempest-VolumesSnapshotTestJSON-311548116 None] Created volume successfully. Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Created reservations ['de1aa574-daf0-4892-be0b-632a099d5e6d', 'd54a053f-9d87-4d6c-ac20-f5552af437b6', 'f2a7ffd3-8676-41fc-9b42-eed90bff7aff', '314c9c4d-ede3-443b-8272-46054d761e41'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:50:07 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Delete snapshot completed successfully. Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-6c8165e9-f271-4970-9183-c325807ed977-delete_snapshot" released by "delete_snapshot" :: held 6.899s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "cinder-e7bf3f5f-e79c-4a95-a3e3-abf185557b4e-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-e7bf3f5f-e79c-4a95-a3e3-abf185557b4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "cinder-quobyte-9e186af7-6126-4fc1-b90a-92c081169ec9" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-quobyte-9e186af7-6126-4fc1-b90a-92c081169ec9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "cinder-quobyte-e7bf3f5f-e79c-4a95-a3e3-abf185557b4e" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-quobyte-e7bf3f5f-e79c-4a95-a3e3-abf185557b4e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Deleting offline snapshot e7bf3f5f-e79c-4a95-a3e3-abf185557b4e of volume 9e186af7-6126-4fc1-b90a-92c081169ec9 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] snapshot_file for this snap is: volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[e196083a-61a6-47e7-8493-2dfdcbac90df]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:07 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e Aug 27 03:50:07 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:07 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5 1073741824" returned: 0 in 0.720s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:07 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5 Aug 27 03:50:07 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:08 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e" returned: 0 in 0.477s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:08 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e186af7-6126-4fc1-b90a-92c081169ec9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:50:08 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd30a577-8665-41ce-bfc5-4497adea71b6]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:08 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5" returned: 0 in 0.275s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:08 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:50:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84614120-c1c8-47b9-a7f1-2ab8082528b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (222cf5e2-22bd-4516-889a-433385751045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:08 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9 Aug 27 03:50:08 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:08 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Volume volume-0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5 (0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5): created successfully Aug 27 03:50:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (222cf5e2-22bd-4516-889a-433385751045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Flow 'volume_create_manager' (4d14059f-65aa-4c4a-ab75-7fcfabf994c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:50:08 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-1fa77644-da34-4897-aba3-65e9ca840254 tempest-VolumesTransfersTest-48792073 None] Created volume successfully. Aug 27 03:50:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e6cd81d7-ba3c-4388-aa55-acbf474137fe tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "cinder-04007f08-7bde-4197-befe-f24e3021928c-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e6cd81d7-ba3c-4388-aa55-acbf474137fe tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-04007f08-7bde-4197-befe-f24e3021928c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e6cd81d7-ba3c-4388-aa55-acbf474137fe tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "cinder-quobyte-04007f08-7bde-4197-befe-f24e3021928c" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e6cd81d7-ba3c-4388-aa55-acbf474137fe tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-04007f08-7bde-4197-befe-f24e3021928c" acquired by "delete_volume" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:08 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb67943-c310-4d6d-8145-cda1e968fe68]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e6cd81d7-ba3c-4388-aa55-acbf474137fe tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04007f08-7bde-4197-befe-f24e3021928c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:08 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:08 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04007f08-7bde-4197-befe-f24e3021928c Aug 27 03:50:08 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9" returned: 0 in 0.455s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:08 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e Aug 27 03:50:08 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:08 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e6cd81d7-ba3c-4388-aa55-acbf474137fe tempest-VolumesSnapshotTestJSON-311548116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04007f08-7bde-4197-befe-f24e3021928c" returned: 0 in 0.388s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e6cd81d7-ba3c-4388-aa55-acbf474137fe tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04007f08-7bde-4197-befe-f24e3021928c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:08 devstack sudo[108530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04007f08-7bde-4197-befe-f24e3021928c Aug 27 03:50:08 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:09 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e" returned: 0 in 0.449s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:09 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e Aug 27 03:50:09 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3ecedeb9-e580-4b6a-ba57-56c9c82c04a7 tempest-TestStampPattern-1729760105 None] Acquiring lock "cinder-0d2094e3-8104-41d8-a618-8f864841069c-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3ecedeb9-e580-4b6a-ba57-56c9c82c04a7 tempest-TestStampPattern-1729760105 None] Lock "cinder-0d2094e3-8104-41d8-a618-8f864841069c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:09 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e6cd81d7-ba3c-4388-aa55-acbf474137fe tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-04007f08-7bde-4197-befe-f24e3021928c" returned: 0 in 0.332s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3ecedeb9-e580-4b6a-ba57-56c9c82c04a7 tempest-TestStampPattern-1729760105 None] Acquiring lock "cinder-quobyte-0d2094e3-8104-41d8-a618-8f864841069c" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e6cd81d7-ba3c-4388-aa55-acbf474137fe tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-04007f08-7bde-4197-befe-f24e3021928c" released by "delete_volume" :: held 0.770s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3ecedeb9-e580-4b6a-ba57-56c9c82c04a7 tempest-TestStampPattern-1729760105 None] Lock "cinder-quobyte-0d2094e3-8104-41d8-a618-8f864841069c" acquired by "delete_volume" :: waited 0.025s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[11477c0c-b4e8-4362-9e5b-6d372a22d99f]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3ecedeb9-e580-4b6a-ba57-56c9c82c04a7 tempest-TestStampPattern-1729760105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0d2094e3-8104-41d8-a618-8f864841069c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-e6cd81d7-ba3c-4388-aa55-acbf474137fe tempest-VolumesSnapshotTestJSON-311548116 None] Created reservations ['a9108b7e-d896-41d8-a001-627cd6006bce', '20aab7f0-2e27-4e4d-8fac-8ab8f818741c', '55bc0f1c-0411-421b-bf49-cd2a61350c3e', '65b2b8de-8852-41a0-ba86-a3ef80a639d8'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:50:09 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9.e7bf3f5f-e79c-4a95-a3e3-abf185557b4e" returned: 0 in 0.330s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:09 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0d2094e3-8104-41d8-a618-8f864841069c Aug 27 03:50:09 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-quobyte-e7bf3f5f-e79c-4a95-a3e3-abf185557b4e" released by "_delete_snapshot" :: held 1.869s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e6cd81d7-ba3c-4388-aa55-acbf474137fe tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e6cd81d7-ba3c-4388-aa55-acbf474137fe tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e6cd81d7-ba3c-4388-aa55-acbf474137fe tempest-VolumesSnapshotTestJSON-311548116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e6cd81d7-ba3c-4388-aa55-acbf474137fe tempest-VolumesSnapshotTestJSON-311548116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e6cd81d7-ba3c-4388-aa55-acbf474137fe tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e6cd81d7-ba3c-4388-aa55-acbf474137fe tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-quobyte-9e186af7-6126-4fc1-b90a-92c081169ec9" released by "delete_snapshot" :: held 1.918s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:09 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:50:09 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:09 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-175324b4-c469-4475-afc6-f9c63cebdf9f tempest-VolumesTransfersTest-1051059713 None] Transfer volume completed successfully. Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Created reservations ['cac3a169-6f7c-432d-afc3-1c5daa89b0fd', 'c01d771d-5888-4716-ae47-89a56357c723', '5a6f3e6e-74c9-4355-8740-4489791ba171', '34111d70-e6bf-4ee2-b36e-63ad4d5b79e4'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c8791c49-43ad-497a-b3dd-7cb5723613b1 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "cinder-eed011b0-398e-4672-a829-24ef815c9a77-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:09 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Delete snapshot completed successfully. Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c8791c49-43ad-497a-b3dd-7cb5723613b1 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-eed011b0-398e-4672-a829-24ef815c9a77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c8791c49-43ad-497a-b3dd-7cb5723613b1 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "cinder-quobyte-2cab9f0a-e1a2-49db-9bfc-06e680e9a409" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-e7bf3f5f-e79c-4a95-a3e3-abf185557b4e-delete_snapshot" released by "delete_snapshot" :: held 2.152s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Snapshots deleted, issuing volume delete {{(pid=94328) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "cinder-quobyte-9e186af7-6126-4fc1-b90a-92c081169ec9" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c8791c49-43ad-497a-b3dd-7cb5723613b1 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-2cab9f0a-e1a2-49db-9bfc-06e680e9a409" acquired by "delete_snapshot" :: waited 0.039s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c8791c49-43ad-497a-b3dd-7cb5723613b1 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "cinder-quobyte-eed011b0-398e-4672-a829-24ef815c9a77" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-quobyte-9e186af7-6126-4fc1-b90a-92c081169ec9" acquired by "delete_volume" :: waited 0.033s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c8791c49-43ad-497a-b3dd-7cb5723613b1 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-eed011b0-398e-4672-a829-24ef815c9a77" acquired by "_delete_snapshot" :: waited 0.069s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-c8791c49-43ad-497a-b3dd-7cb5723613b1 tempest-VolumesSnapshotTestJSON-311548116 None] Deleting offline snapshot eed011b0-398e-4672-a829-24ef815c9a77 of volume 2cab9f0a-e1a2-49db-9bfc-06e680e9a409 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-c8791c49-43ad-497a-b3dd-7cb5723613b1 tempest-VolumesSnapshotTestJSON-311548116 None] snapshot_file for this snap is: volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.eed011b0-398e-4672-a829-24ef815c9a77 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb9d4ec-790d-453c-b1a8-02473a9a870a]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:09 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe46651c-9e2a-4834-bdcb-5a490999eee5]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c8791c49-43ad-497a-b3dd-7cb5723613b1 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.eed011b0-398e-4672-a829-24ef815c9a77 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e6cd81d7-ba3c-4388-aa55-acbf474137fe tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.363s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-e6cd81d7-ba3c-4388-aa55-acbf474137fe tempest-VolumesSnapshotTestJSON-311548116 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:50:09 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3ecedeb9-e580-4b6a-ba57-56c9c82c04a7 tempest-TestStampPattern-1729760105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0d2094e3-8104-41d8-a618-8f864841069c" returned: 0 in 0.557s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3ecedeb9-e580-4b6a-ba57-56c9c82c04a7 tempest-TestStampPattern-1729760105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0d2094e3-8104-41d8-a618-8f864841069c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:09 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e6cd81d7-ba3c-4388-aa55-acbf474137fe tempest-VolumesSnapshotTestJSON-311548116 None] Deleted volume successfully. Aug 27 03:50:09 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0d2094e3-8104-41d8-a618-8f864841069c Aug 27 03:50:09 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e6cd81d7-ba3c-4388-aa55-acbf474137fe tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-04007f08-7bde-4197-befe-f24e3021928c-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:09 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9 Aug 27 03:50:09 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:09 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.eed011b0-398e-4672-a829-24ef815c9a77 Aug 27 03:50:09 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:10 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3ecedeb9-e580-4b6a-ba57-56c9c82c04a7 tempest-TestStampPattern-1729760105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0d2094e3-8104-41d8-a618-8f864841069c" returned: 0 in 0.374s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-841db056-1057-4c24-a44a-430b55f4bde2 tempest-VolumesTransfersTest-138054984 None] Acquiring lock "cinder-0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3ecedeb9-e580-4b6a-ba57-56c9c82c04a7 tempest-TestStampPattern-1729760105 None] Lock "cinder-quobyte-0d2094e3-8104-41d8-a618-8f864841069c" released by "delete_volume" :: held 0.995s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-841db056-1057-4c24-a44a-430b55f4bde2 tempest-VolumesTransfersTest-138054984 None] Lock "cinder-0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:10 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9" returned: 0 in 0.526s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:10 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:10 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9 Aug 27 03:50:10 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-841db056-1057-4c24-a44a-430b55f4bde2 tempest-VolumesTransfersTest-138054984 None] Acquiring lock "cinder-quobyte-0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c8791c49-43ad-497a-b3dd-7cb5723613b1 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.eed011b0-398e-4672-a829-24ef815c9a77" returned: 0 in 0.537s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-c8791c49-43ad-497a-b3dd-7cb5723613b1 tempest-VolumesSnapshotTestJSON-311548116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbc9f57-dae1-440a-93ab-80779b8bf825]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c8791c49-43ad-497a-b3dd-7cb5723613b1 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-841db056-1057-4c24-a44a-430b55f4bde2 tempest-VolumesTransfersTest-138054984 None] Lock "cinder-quobyte-0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5" acquired by "delete_volume" :: waited 0.057s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-3ecedeb9-e580-4b6a-ba57-56c9c82c04a7 tempest-TestStampPattern-1729760105 None] Created reservations ['08098a35-5acf-4bf3-9d19-7a461fa6df7f', 'ede9433f-9060-47f5-9030-abbb8c918f64', '18feaaf5-f00f-413b-a8e4-05b56c541fba', '3d1e896d-d916-42d6-9306-32c722bec267'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c996f0-0453-4313-ae5a-f27ffcac8043]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-841db056-1057-4c24-a44a-430b55f4bde2 tempest-VolumesTransfersTest-138054984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:10 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409 Aug 27 03:50:10 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3ecedeb9-e580-4b6a-ba57-56c9c82c04a7 tempest-TestStampPattern-1729760105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3ecedeb9-e580-4b6a-ba57-56c9c82c04a7 tempest-TestStampPattern-1729760105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3ecedeb9-e580-4b6a-ba57-56c9c82c04a7 tempest-TestStampPattern-1729760105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3ecedeb9-e580-4b6a-ba57-56c9c82c04a7 tempest-TestStampPattern-1729760105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3ecedeb9-e580-4b6a-ba57-56c9c82c04a7 tempest-TestStampPattern-1729760105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3ecedeb9-e580-4b6a-ba57-56c9c82c04a7 tempest-TestStampPattern-1729760105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:10 devstack sudo[108562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5 Aug 27 03:50:10 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:10 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9e186af7-6126-4fc1-b90a-92c081169ec9" returned: 0 in 0.272s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:10 devstack sudo[108565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:50:10 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-quobyte-9e186af7-6126-4fc1-b90a-92c081169ec9" released by "delete_volume" :: held 0.908s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Created reservations ['fe97e1c0-f391-4698-b40f-fa791b083161', '74658650-f1ce-4e20-b0c1-591830f56a41', 'f11b86b7-8143-45cd-a154-c6e10c339b1b', '142cfda0-75e5-46ce-876e-d6bca1d599dd'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:10 devstack sudo[108570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:50:10 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:10 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3ecedeb9-e580-4b6a-ba57-56c9c82c04a7 tempest-TestStampPattern-1729760105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.295s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-3ecedeb9-e580-4b6a-ba57-56c9c82c04a7 tempest-TestStampPattern-1729760105 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:50:10 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-3ecedeb9-e580-4b6a-ba57-56c9c82c04a7 tempest-TestStampPattern-1729760105 None] Deleted volume successfully. Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3ecedeb9-e580-4b6a-ba57-56c9c82c04a7 tempest-TestStampPattern-1729760105 None] Lock "cinder-0d2094e3-8104-41d8-a618-8f864841069c-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:10 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-841db056-1057-4c24-a44a-430b55f4bde2 tempest-VolumesTransfersTest-138054984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5" returned: 0 in 0.484s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-841db056-1057-4c24-a44a-430b55f4bde2 tempest-VolumesTransfersTest-138054984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:10 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5 Aug 27 03:50:10 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:11 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.294s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:11 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:50:11 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Deleted volume successfully. Aug 27 03:50:11 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c8791c49-43ad-497a-b3dd-7cb5723613b1 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409" returned: 0 in 0.698s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c8791c49-43ad-497a-b3dd-7cb5723613b1 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.eed011b0-398e-4672-a829-24ef815c9a77 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-77123a8e-39f7-4bee-a77e-2aa88cd7144e tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-9e186af7-6126-4fc1-b90a-92c081169ec9-delete_volume" released by "delete_volume" :: held 10.624s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:11 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.eed011b0-398e-4672-a829-24ef815c9a77 Aug 27 03:50:11 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:11 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-841db056-1057-4c24-a44a-430b55f4bde2 tempest-VolumesTransfersTest-138054984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5" returned: 0 in 0.319s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-841db056-1057-4c24-a44a-430b55f4bde2 tempest-VolumesTransfersTest-138054984 None] Lock "cinder-quobyte-0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5" released by "delete_volume" :: held 0.865s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:11 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-841db056-1057-4c24-a44a-430b55f4bde2 tempest-VolumesTransfersTest-138054984 None] Created reservations ['19801b50-6109-4909-b3b2-d38ebc4844d2', '680f34da-c232-45cc-b6d3-1c501a0c7a60', '64776921-d64f-4934-8c9b-1d5621c86efc', '6aa411cc-154d-4b4e-8ad7-09f374c18a60'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:50:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-841db056-1057-4c24-a44a-430b55f4bde2 tempest-VolumesTransfersTest-138054984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-841db056-1057-4c24-a44a-430b55f4bde2 tempest-VolumesTransfersTest-138054984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-841db056-1057-4c24-a44a-430b55f4bde2 tempest-VolumesTransfersTest-138054984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-841db056-1057-4c24-a44a-430b55f4bde2 tempest-VolumesTransfersTest-138054984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-841db056-1057-4c24-a44a-430b55f4bde2 tempest-VolumesTransfersTest-138054984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-841db056-1057-4c24-a44a-430b55f4bde2 tempest-VolumesTransfersTest-138054984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:11 devstack sudo[108587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:50:11 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:11 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c8791c49-43ad-497a-b3dd-7cb5723613b1 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.eed011b0-398e-4672-a829-24ef815c9a77" returned: 0 in 0.518s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c8791c49-43ad-497a-b3dd-7cb5723613b1 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.eed011b0-398e-4672-a829-24ef815c9a77 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:11 devstack sudo[108589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.eed011b0-398e-4672-a829-24ef815c9a77 Aug 27 03:50:11 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:11 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-841db056-1057-4c24-a44a-430b55f4bde2 tempest-VolumesTransfersTest-138054984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.450s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:11 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-841db056-1057-4c24-a44a-430b55f4bde2 tempest-VolumesTransfersTest-138054984 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:50:11 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-841db056-1057-4c24-a44a-430b55f4bde2 tempest-VolumesTransfersTest-138054984 None] Deleted volume successfully. Aug 27 03:50:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-841db056-1057-4c24-a44a-430b55f4bde2 tempest-VolumesTransfersTest-138054984 None] Lock "cinder-0170950e-9e2f-4b4a-b4ac-c9e93c8c02a5-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0af342bc-6db1-41e9-bde4-e45213f571aa tempest-TestStampPattern-1729760105 None] Acquiring lock "cinder-35fbf2f2-e6eb-47be-80a0-b168125fabca-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0af342bc-6db1-41e9-bde4-e45213f571aa tempest-TestStampPattern-1729760105 None] Lock "cinder-35fbf2f2-e6eb-47be-80a0-b168125fabca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0af342bc-6db1-41e9-bde4-e45213f571aa tempest-TestStampPattern-1729760105 None] Acquiring lock "cinder-quobyte-ee42fb02-6dfc-46bf-a43c-5addb128c5a0" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0af342bc-6db1-41e9-bde4-e45213f571aa tempest-TestStampPattern-1729760105 None] Lock "cinder-quobyte-ee42fb02-6dfc-46bf-a43c-5addb128c5a0" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0af342bc-6db1-41e9-bde4-e45213f571aa tempest-TestStampPattern-1729760105 None] Acquiring lock "cinder-quobyte-35fbf2f2-e6eb-47be-80a0-b168125fabca" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0af342bc-6db1-41e9-bde4-e45213f571aa tempest-TestStampPattern-1729760105 None] Lock "cinder-quobyte-35fbf2f2-e6eb-47be-80a0-b168125fabca" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-0af342bc-6db1-41e9-bde4-e45213f571aa tempest-TestStampPattern-1729760105 None] Deleting offline snapshot 35fbf2f2-e6eb-47be-80a0-b168125fabca of volume ee42fb02-6dfc-46bf-a43c-5addb128c5a0 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:50:12 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-0af342bc-6db1-41e9-bde4-e45213f571aa tempest-TestStampPattern-1729760105 None] snapshot_file for this snap is: volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.35fbf2f2-e6eb-47be-80a0-b168125fabca {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[67abb5f0-565a-49dc-bbe5-10670655b84d]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0af342bc-6db1-41e9-bde4-e45213f571aa tempest-TestStampPattern-1729760105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.35fbf2f2-e6eb-47be-80a0-b168125fabca {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c8791c49-43ad-497a-b3dd-7cb5723613b1 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409.eed011b0-398e-4672-a829-24ef815c9a77" returned: 0 in 0.620s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Flow 'volume_create_manager' (931f426b-5179-4490-8cd6-a06ee126eced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f82ff9-b18e-43a3-b197-925ea85b4038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c8791c49-43ad-497a-b3dd-7cb5723613b1 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-eed011b0-398e-4672-a829-24ef815c9a77" released by "_delete_snapshot" :: held 2.561s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c8791c49-43ad-497a-b3dd-7cb5723613b1 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-2cab9f0a-e1a2-49db-9bfc-06e680e9a409" released by "delete_snapshot" :: held 2.645s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f82ff9-b18e-43a3-b197-925ea85b4038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2099413401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e000ad2-025c-4e9e-8048-c704426118ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6fef6749d734484ae8dfcdf2394c3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:50:12Z,use_quota=True,user_id='6fd30fa731e14134b3fe8c0f790264a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d218e79-0b1e-451c-863c-355ac4b9a0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:12 devstack sudo[108627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.35fbf2f2-e6eb-47be-80a0-b168125fabca Aug 27 03:50:12 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d218e79-0b1e-451c-863c-355ac4b9a0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9afbd1a2-5064-4040-a9cb-a1e778ab7494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9afbd1a2-5064-4040-a9cb-a1e778ab7494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e000ad2-025c-4e9e-8048-c704426118ec', 'volume_name': 'volume-2e000ad2-025c-4e9e-8048-c704426118ec', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c0a02e7-b2cb-4fc1-b092-5b70904c7433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c0a02e7-b2cb-4fc1-b092-5b70904c7433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db74faa-f560-4efd-8c96-b794d3d3cb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:12 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Volume 2e000ad2-025c-4e9e-8048-c704426118ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e000ad2-025c-4e9e-8048-c704426118ec', 'volume_size': 1} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2099413401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e000ad2-025c-4e9e-8048-c704426118ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6fef6749d734484ae8dfcdf2394c3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:50:12Z,use_quota=True,user_id='6fd30fa731e14134b3fe8c0f790264a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Creating volume 2e000ad2-025c-4e9e-8048-c704426118ec {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:50:12 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:12 devstack sudo[108631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec 1073741824 Aug 27 03:50:12 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Flow 'volume_create_manager' (c57a8b6b-6a80-4903-b00c-04b5f5fe1ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e235333b-c316-4f26-a1a8-ab79f299be20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e235333b-c316-4f26-a1a8-ab79f299be20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-525691002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4859f7fd4a9e40d2972eb5cb48ae9546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:50:12Z,use_quota=True,user_id='d72348d811944b68a40e9fb41246394f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da2be6c-c8a6-45da-91d0-a70d7b0b7b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da2be6c-c8a6-45da-91d0-a70d7b0b7b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbbeab24-a2e3-4850-b990-a1590957ec83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbbeab24-a2e3-4850-b990-a1590957ec83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60', 'volume_name': 'volume-e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b43affb3-6574-4299-a1be-043d7635e025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b43affb3-6574-4299-a1be-043d7635e025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4535de09-da06-40d8-995e-061c4e933ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:12 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Volume e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60', 'volume_size': 1} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-c8791c49-43ad-497a-b3dd-7cb5723613b1 tempest-VolumesSnapshotTestJSON-311548116 None] Created reservations ['19cd5c96-34b3-437d-9117-08aed5f7b63a', 'f1d49f25-4473-4a8f-935c-59f81e607ed1', 'e79b29d8-3c36-430a-beeb-3d6cb04fa716', '2f6c6620-cec5-4b9e-84b6-7c0fb02ab332'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:50:12 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0af342bc-6db1-41e9-bde4-e45213f571aa tempest-TestStampPattern-1729760105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.35fbf2f2-e6eb-47be-80a0-b168125fabca" returned: 0 in 0.423s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-0af342bc-6db1-41e9-bde4-e45213f571aa tempest-TestStampPattern-1729760105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[b074cfa7-2192-4557-b251-243d41d5fd2e]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0af342bc-6db1-41e9-bde4-e45213f571aa tempest-TestStampPattern-1729760105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:12 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-c8791c49-43ad-497a-b3dd-7cb5723613b1 tempest-VolumesSnapshotTestJSON-311548116 None] Delete snapshot completed successfully. Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c8791c49-43ad-497a-b3dd-7cb5723613b1 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-eed011b0-398e-4672-a829-24ef815c9a77-delete_snapshot" released by "delete_snapshot" :: held 3.042s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:12 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0 Aug 27 03:50:12 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:12 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec 1073741824" returned: 0 in 0.501s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:12 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec Aug 27 03:50:12 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e367d1da-4a62-431a-aeeb-3745b5f2e8c9 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "cinder-2cab9f0a-e1a2-49db-9bfc-06e680e9a409-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e367d1da-4a62-431a-aeeb-3745b5f2e8c9 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-2cab9f0a-e1a2-49db-9bfc-06e680e9a409-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e367d1da-4a62-431a-aeeb-3745b5f2e8c9 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "cinder-quobyte-2cab9f0a-e1a2-49db-9bfc-06e680e9a409" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e367d1da-4a62-431a-aeeb-3745b5f2e8c9 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-2cab9f0a-e1a2-49db-9bfc-06e680e9a409" acquired by "delete_volume" :: waited 0.027s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[4206b593-315d-4f09-80ff-7475f558125c]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e367d1da-4a62-431a-aeeb-3745b5f2e8c9 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:13 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec" returned: 0 in 0.313s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.693s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-525691002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4859f7fd4a9e40d2972eb5cb48ae9546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:50:12Z,use_quota=True,user_id='d72348d811944b68a40e9fb41246394f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Creating volume e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:50:13 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:13 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0af342bc-6db1-41e9-bde4-e45213f571aa tempest-TestStampPattern-1729760105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0" returned: 0 in 0.621s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0af342bc-6db1-41e9-bde4-e45213f571aa tempest-TestStampPattern-1729760105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.35fbf2f2-e6eb-47be-80a0-b168125fabca {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:13 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60 1073741824 Aug 27 03:50:13 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db74faa-f560-4efd-8c96-b794d3d3cb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e000ad2-025c-4e9e-8048-c704426118ec', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f34b3caf-1eae-465f-a83d-a4c4a34954b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:13 devstack sudo[108651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.35fbf2f2-e6eb-47be-80a0-b168125fabca Aug 27 03:50:13 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:13 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Volume volume-2e000ad2-025c-4e9e-8048-c704426118ec (2e000ad2-025c-4e9e-8048-c704426118ec): created successfully Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f34b3caf-1eae-465f-a83d-a4c4a34954b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Flow 'volume_create_manager' (931f426b-5179-4490-8cd6-a06ee126eced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:50:13 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-569591c1-bc86-4343-b328-26ca81ba8bcb tempest-VolumesDeleteCascade-1695356368 None] Created volume successfully. Aug 27 03:50:13 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409 Aug 27 03:50:13 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:13 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e367d1da-4a62-431a-aeeb-3745b5f2e8c9 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409" returned: 0 in 0.394s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e367d1da-4a62-431a-aeeb-3745b5f2e8c9 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:13 devstack sudo[108666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409 Aug 27 03:50:13 devstack sudo[108666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:13 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0af342bc-6db1-41e9-bde4-e45213f571aa tempest-TestStampPattern-1729760105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.35fbf2f2-e6eb-47be-80a0-b168125fabca" returned: 0 in 0.384s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0af342bc-6db1-41e9-bde4-e45213f571aa tempest-TestStampPattern-1729760105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.35fbf2f2-e6eb-47be-80a0-b168125fabca {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:13 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.35fbf2f2-e6eb-47be-80a0-b168125fabca Aug 27 03:50:13 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:13 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60 1073741824" returned: 0 in 0.458s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:13 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60 Aug 27 03:50:13 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:13 devstack sudo[108666]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e367d1da-4a62-431a-aeeb-3745b5f2e8c9 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cab9f0a-e1a2-49db-9bfc-06e680e9a409" returned: 0 in 0.282s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:13 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e367d1da-4a62-431a-aeeb-3745b5f2e8c9 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-2cab9f0a-e1a2-49db-9bfc-06e680e9a409" released by "delete_volume" :: held 0.764s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0af342bc-6db1-41e9-bde4-e45213f571aa tempest-TestStampPattern-1729760105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0.35fbf2f2-e6eb-47be-80a0-b168125fabca" returned: 0 in 0.261s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0af342bc-6db1-41e9-bde4-e45213f571aa tempest-TestStampPattern-1729760105 None] Lock "cinder-quobyte-35fbf2f2-e6eb-47be-80a0-b168125fabca" released by "_delete_snapshot" :: held 1.854s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0af342bc-6db1-41e9-bde4-e45213f571aa tempest-TestStampPattern-1729760105 None] Lock "cinder-quobyte-ee42fb02-6dfc-46bf-a43c-5addb128c5a0" released by "delete_snapshot" :: held 1.902s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:14 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60" returned: 0 in 0.271s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4535de09-da06-40d8-995e-061c4e933ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f3b27d-56d2-4954-ae81-1aec134d3f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-e367d1da-4a62-431a-aeeb-3745b5f2e8c9 tempest-VolumesSnapshotTestJSON-311548116 None] Created reservations ['19af92ed-90a3-462b-b30e-5c3faecaf35b', '71a760d0-be2f-41f5-8924-6eaaf07a173c', '58a2ec8d-91ec-40a4-9172-c9e7750111b3', '9f4da655-a9c3-4fcd-859f-859f582e2092'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:50:14 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Volume volume-e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60 (e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60): created successfully Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f3b27d-56d2-4954-ae81-1aec134d3f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Flow 'volume_create_manager' (c57a8b6b-6a80-4903-b00c-04b5f5fe1ebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:50:14 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-fede1122-02b4-4e4c-93ac-64c57cea3deb tempest-VolumesTransfersTest-48792073 None] Created volume successfully. Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e367d1da-4a62-431a-aeeb-3745b5f2e8c9 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e367d1da-4a62-431a-aeeb-3745b5f2e8c9 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e367d1da-4a62-431a-aeeb-3745b5f2e8c9 tempest-VolumesSnapshotTestJSON-311548116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e367d1da-4a62-431a-aeeb-3745b5f2e8c9 tempest-VolumesSnapshotTestJSON-311548116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e367d1da-4a62-431a-aeeb-3745b5f2e8c9 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e367d1da-4a62-431a-aeeb-3745b5f2e8c9 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-0af342bc-6db1-41e9-bde4-e45213f571aa tempest-TestStampPattern-1729760105 None] Created reservations ['eebf623a-ab35-426d-a18f-31c0554bcea7', 'c745277f-c1d1-422c-9e8e-cadc96fd5065', 'd2106f5a-deae-4378-ab60-700d6449e364', 'c6796c36-ad49-473a-864e-b47657cf4fdc'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:50:14 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:50:14 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:14 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-0af342bc-6db1-41e9-bde4-e45213f571aa tempest-TestStampPattern-1729760105 None] Delete snapshot completed successfully. Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0af342bc-6db1-41e9-bde4-e45213f571aa tempest-TestStampPattern-1729760105 None] Lock "cinder-35fbf2f2-e6eb-47be-80a0-b168125fabca-delete_snapshot" released by "delete_snapshot" :: held 2.298s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e96d1a97-2a3b-4ab2-ba76-d9c6a74e1285 tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e96d1a97-2a3b-4ab2-ba76-d9c6a74e1285 tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-e96d1a97-2a3b-4ab2-ba76-d9c6a74e1285 tempest-VolumesDeleteCascade-1695356368 None] Creating offline snapshot 3eacf180-adf3-4ce3-b169-b4904a000ec5 of volume 2e000ad2-025c-4e9e-8048-c704426118ec {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4fccfa-d567-4b3a-a064-d1656133df22]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e96d1a97-2a3b-4ab2-ba76-d9c6a74e1285 tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:14 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e367d1da-4a62-431a-aeeb-3745b5f2e8c9 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.398s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-e367d1da-4a62-431a-aeeb-3745b5f2e8c9 tempest-VolumesSnapshotTestJSON-311548116 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:50:14 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e367d1da-4a62-431a-aeeb-3745b5f2e8c9 tempest-VolumesSnapshotTestJSON-311548116 None] Deleted volume successfully. Aug 27 03:50:14 devstack sudo[108677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec Aug 27 03:50:14 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e367d1da-4a62-431a-aeeb-3745b5f2e8c9 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-2cab9f0a-e1a2-49db-9bfc-06e680e9a409-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-def9aeb3-4cfe-4020-8f8f-cdd4326fe907 tempest-VolumesTransfersTest-138054984 None] Acquiring lock "cinder-e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-def9aeb3-4cfe-4020-8f8f-cdd4326fe907 tempest-VolumesTransfersTest-138054984 None] Lock "cinder-e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-def9aeb3-4cfe-4020-8f8f-cdd4326fe907 tempest-VolumesTransfersTest-138054984 None] Acquiring lock "cinder-quobyte-e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-def9aeb3-4cfe-4020-8f8f-cdd4326fe907 tempest-VolumesTransfersTest-138054984 None] Lock "cinder-quobyte-e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60" acquired by "delete_volume" :: waited 0.055s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:14 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:50:14 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e6b24a-2e5c-4b55-8c9b-d65c1ab62c72]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-def9aeb3-4cfe-4020-8f8f-cdd4326fe907 tempest-VolumesTransfersTest-138054984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:15 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e96d1a97-2a3b-4ab2-ba76-d9c6a74e1285 tempest-VolumesDeleteCascade-1695356368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec" returned: 0 in 0.660s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e96d1a97-2a3b-4ab2-ba76-d9c6a74e1285 tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.3eacf180-adf3-4ce3-b169-b4904a000ec5 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:50:15 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60 Aug 27 03:50:15 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Flow 'volume_create_manager' (08d12b53-6db4-4a0c-b0fa-4c8d33024856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75283150-b020-40c3-b599-a80ddb3831a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:15 devstack sudo[108691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.3eacf180-adf3-4ce3-b169-b4904a000ec5 1G Aug 27 03:50:15 devstack sudo[108691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75283150-b020-40c3-b599-a80ddb3831a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-25934979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6997b4bd-2343-4815-b00f-da2a0f1d05f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983c4a98a134460ea1a6b9c2c63ae559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:50:15Z,use_quota=True,user_id='87c149b133bc476da1c8f28fe31dd267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c49e88f-0483-4610-883e-1c64b769a410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c49e88f-0483-4610-883e-1c64b769a410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6f1455-2f81-4988-a0e3-ade6caf82668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6f1455-2f81-4988-a0e3-ade6caf82668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6997b4bd-2343-4815-b00f-da2a0f1d05f3', 'volume_name': 'volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c7a3cf-a23a-418b-bd4a-6c3be054409a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c7a3cf-a23a-418b-bd4a-6c3be054409a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49bbce11-7f26-4358-b254-0ab757a3141d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:15 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Volume 6997b4bd-2343-4815-b00f-da2a0f1d05f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3', 'volume_size': 1} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:15 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.395s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager._thread_info {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread count: 28 {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread info: [<_MainThread(MainThread, started 134250325188736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 03:50:15 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-def9aeb3-4cfe-4020-8f8f-cdd4326fe907 tempest-VolumesTransfersTest-138054984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60" returned: 0 in 0.506s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-def9aeb3-4cfe-4020-8f8f-cdd4326fe907 tempest-VolumesTransfersTest-138054984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:15 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60 Aug 27 03:50:15 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:15 devstack sudo[108691]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e96d1a97-2a3b-4ab2-ba76-d9c6a74e1285 tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.3eacf180-adf3-4ce3-b169-b4904a000ec5 1G" returned: 0 in 0.577s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e96d1a97-2a3b-4ab2-ba76-d9c6a74e1285 tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e000ad2-025c-4e9e-8048-c704426118ec -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.3eacf180-adf3-4ce3-b169-b4904a000ec5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:15 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e000ad2-025c-4e9e-8048-c704426118ec -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.3eacf180-adf3-4ce3-b169-b4904a000ec5 Aug 27 03:50:15 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:15 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-def9aeb3-4cfe-4020-8f8f-cdd4326fe907 tempest-VolumesTransfersTest-138054984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60" returned: 0 in 0.292s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-def9aeb3-4cfe-4020-8f8f-cdd4326fe907 tempest-VolumesTransfersTest-138054984 None] Lock "cinder-quobyte-e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60" released by "delete_volume" :: held 0.863s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-def9aeb3-4cfe-4020-8f8f-cdd4326fe907 tempest-VolumesTransfersTest-138054984 None] Created reservations ['490e994e-0a17-4515-9aad-367b28104c2d', '6f169c3f-290e-4172-ba75-6ed9556a31fc', '1d75bfac-127d-46aa-b358-ee52646d3db7', '6051dfcc-b1c9-401e-9350-84c7cc326023'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-def9aeb3-4cfe-4020-8f8f-cdd4326fe907 tempest-VolumesTransfersTest-138054984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-def9aeb3-4cfe-4020-8f8f-cdd4326fe907 tempest-VolumesTransfersTest-138054984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-def9aeb3-4cfe-4020-8f8f-cdd4326fe907 tempest-VolumesTransfersTest-138054984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-def9aeb3-4cfe-4020-8f8f-cdd4326fe907 tempest-VolumesTransfersTest-138054984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-def9aeb3-4cfe-4020-8f8f-cdd4326fe907 tempest-VolumesTransfersTest-138054984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-def9aeb3-4cfe-4020-8f8f-cdd4326fe907 tempest-VolumesTransfersTest-138054984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:15 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:50:15 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:16 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e96d1a97-2a3b-4ab2-ba76-d9c6a74e1285 tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e000ad2-025c-4e9e-8048-c704426118ec -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.3eacf180-adf3-4ce3-b169-b4904a000ec5" returned: 0 in 0.371s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:16 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-e96d1a97-2a3b-4ab2-ba76-d9c6a74e1285 tempest-VolumesDeleteCascade-1695356368 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.3eacf180-adf3-4ce3-b169-b4904a000ec5 is being set with open permissions: ugo+rw Aug 27 03:50:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e96d1a97-2a3b-4ab2-ba76-d9c6a74e1285 tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.3eacf180-adf3-4ce3-b169-b4904a000ec5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:16 devstack sudo[108714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.3eacf180-adf3-4ce3-b169-b4904a000ec5 Aug 27 03:50:16 devstack sudo[108714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:16 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-def9aeb3-4cfe-4020-8f8f-cdd4326fe907 tempest-VolumesTransfersTest-138054984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.397s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:16 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-def9aeb3-4cfe-4020-8f8f-cdd4326fe907 tempest-VolumesTransfersTest-138054984 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:50:16 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-def9aeb3-4cfe-4020-8f8f-cdd4326fe907 tempest-VolumesTransfersTest-138054984 None] Deleted volume successfully. Aug 27 03:50:16 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-def9aeb3-4cfe-4020-8f8f-cdd4326fe907 tempest-VolumesTransfersTest-138054984 None] Lock "cinder-e30d1c7d-27f9-4744-80c3-a3a7ae5b5f60-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:16 devstack sudo[108714]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e96d1a97-2a3b-4ab2-ba76-d9c6a74e1285 tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.3eacf180-adf3-4ce3-b169-b4904a000ec5" returned: 0 in 0.409s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e96d1a97-2a3b-4ab2-ba76-d9c6a74e1285 tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:16 devstack sudo[108720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.info Aug 27 03:50:16 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:16 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e96d1a97-2a3b-4ab2-ba76-d9c6a74e1285 tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.info" returned: 0 in 0.311s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:16 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-e96d1a97-2a3b-4ab2-ba76-d9c6a74e1285 tempest-VolumesDeleteCascade-1695356368 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.info is being set with open permissions: ugo+rw Aug 27 03:50:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e96d1a97-2a3b-4ab2-ba76-d9c6a74e1285 tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:16 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.info Aug 27 03:50:16 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:17 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e96d1a97-2a3b-4ab2-ba76-d9c6a74e1285 tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.info" returned: 0 in 0.411s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e96d1a97-2a3b-4ab2-ba76-d9c6a74e1285 tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.876s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.051s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:17 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-25934979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6997b4bd-2343-4815-b00f-da2a0f1d05f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983c4a98a134460ea1a6b9c2c63ae559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:50:15Z,use_quota=True,user_id='87c149b133bc476da1c8f28fe31dd267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:50:17 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Creating volume 6997b4bd-2343-4815-b00f-da2a0f1d05f3 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:50:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:17 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:17 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:17 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:50:17 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:50:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:17 devstack sudo[108746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3 1073741824 Aug 27 03:50:17 devstack sudo[108746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:17 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e96d1a97-2a3b-4ab2-ba76-d9c6a74e1285 tempest-VolumesDeleteCascade-1695356368 None] Create snapshot completed successfully Aug 27 03:50:17 devstack sudo[108746]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3 1073741824" returned: 0 in 0.649s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:18 devstack sudo[108757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3 Aug 27 03:50:18 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:18 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3" returned: 0 in 0.493s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49bbce11-7f26-4358-b254-0ab757a3141d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60d6ac8-6128-498a-9656-c137faeb929f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:18 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Volume volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3 (6997b4bd-2343-4815-b00f-da2a0f1d05f3): created successfully Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60d6ac8-6128-498a-9656-c137faeb929f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Flow 'volume_create_manager' (08d12b53-6db4-4a0c-b0fa-4c8d33024856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:50:18 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-60805023-4c62-4f48-a940-ad113c6fd535 tempest-VolumesSnapshotTestJSON-311548116 None] Created volume successfully. Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Flow 'volume_create_manager' (f25ea49a-c40d-4c88-b744-89629934e808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e461ab0-e7be-4eb2-9c8c-cfbf9b36fa41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e461ab0-e7be-4eb2-9c8c-cfbf9b36fa41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-253527780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f160146-1a74-4627-bb13-46e0934d96ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6fef6749d734484ae8dfcdf2394c3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3eacf180-adf3-4ce3-b169-b4904a000ec5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:50:18Z,use_quota=True,user_id='6fd30fa731e14134b3fe8c0f790264a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0ae474-7e22-43b9-9629-e39ecdd0617e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0ae474-7e22-43b9-9629-e39ecdd0617e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (619cf9e6-c352-491a-95f1-4699f3ff8881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (619cf9e6-c352-491a-95f1-4699f3ff8881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8f160146-1a74-4627-bb13-46e0934d96ec', 'volume_name': 'volume-8f160146-1a74-4627-bb13-46e0934d96ec', 'volume_size': 1, 'snapshot_id': '3eacf180-adf3-4ce3-b169-b4904a000ec5'}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146f31b9-5779-4515-bde7-2def46f1e18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146f31b9-5779-4515-bde7-2def46f1e18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1abc4ef-2190-4ffd-885e-6c5632df3914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:18 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Volume 8f160146-1a74-4627-bb13-46e0934d96ec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8f160146-1a74-4627-bb13-46e0934d96ec', 'volume_size': 1, 'snapshot_id': '3eacf180-adf3-4ce3-b169-b4904a000ec5'} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "cinder-quobyte-3eacf180-adf3-4ce3-b169-b4904a000ec5-8f160146-1a74-4627-bb13-46e0934d96ec" by "_create_volume_from_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-quobyte-3eacf180-adf3-4ce3-b169-b4904a000ec5-8f160146-1a74-4627-bb13-46e0934d96ec" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Creating volume 8f160146-1a74-4627-bb13-46e0934d96ec from snapshot 3eacf180-adf3-4ce3-b169-b4904a000ec5 {{(pid=94328) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "cinder-quobyte-8f160146-1a74-4627-bb13-46e0934d96ec" by "_copy_volume_from_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-quobyte-8f160146-1a74-4627-bb13-46e0934d96ec" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] snapshot: 3eacf180-adf3-4ce3-b169-b4904a000ec5, volume: 8f160146-1a74-4627-bb13-46e0934d96ec, {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1743ed-9e4a-4fd9-a07f-d64b4b8be8db]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.3eacf180-adf3-4ce3-b169-b4904a000ec5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:19 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.3eacf180-adf3-4ce3-b169-b4904a000ec5 Aug 27 03:50:19 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:19 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.3eacf180-adf3-4ce3-b169-b4904a000ec5" returned: 0 in 0.436s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e000ad2-025c-4e9e-8048-c704426118ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:50:19 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2dd8b1-e7ab-4f30-9e36-d496a18a4b31]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:19 devstack sudo[108767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec Aug 27 03:50:19 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ed2af3a3-1f10-44f4-b690-8e8986cde86a tempest-TestStampPattern-1729760105 None] Acquiring lock "cinder-ee42fb02-6dfc-46bf-a43c-5addb128c5a0-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ed2af3a3-1f10-44f4-b690-8e8986cde86a tempest-TestStampPattern-1729760105 None] Lock "cinder-ee42fb02-6dfc-46bf-a43c-5addb128c5a0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6ace7cf4-b595-4d5e-96e0-66270179d0ff tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ed2af3a3-1f10-44f4-b690-8e8986cde86a tempest-TestStampPattern-1729760105 None] Acquiring lock "cinder-quobyte-ee42fb02-6dfc-46bf-a43c-5addb128c5a0" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ed2af3a3-1f10-44f4-b690-8e8986cde86a tempest-TestStampPattern-1729760105 None] Lock "cinder-quobyte-ee42fb02-6dfc-46bf-a43c-5addb128c5a0" acquired by "delete_volume" :: waited 0.018s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:19 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec" returned: 0 in 0.486s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] will copy from snapshot at /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 27 03:50:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Creating direct copy from snapshot {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 27 03:50:19 devstack cinder-volume[94328]: DEBUG cinder.utils [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Path /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8f160146-1a74-4627-bb13-46e0934d96ec not found in is_blk_device check {{(pid=94328) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 27 03:50:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8f160146-1a74-4627-bb13-46e0934d96ec {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:19 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[894a3d29-18b5-4662-88f4-33f83dd22120]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ed2af3a3-1f10-44f4-b690-8e8986cde86a tempest-TestStampPattern-1729760105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:19 devstack sudo[108772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8f160146-1a74-4627-bb13-46e0934d96ec Aug 27 03:50:19 devstack sudo[108772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:19 devstack sudo[108774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0 Aug 27 03:50:19 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:20 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ed2af3a3-1f10-44f4-b690-8e8986cde86a tempest-TestStampPattern-1729760105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0" returned: 0 in 0.435s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ed2af3a3-1f10-44f4-b690-8e8986cde86a tempest-TestStampPattern-1729760105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:20 devstack sudo[108783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0 Aug 27 03:50:20 devstack sudo[108783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:21 devstack sudo[108783]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ed2af3a3-1f10-44f4-b690-8e8986cde86a tempest-TestStampPattern-1729760105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-ee42fb02-6dfc-46bf-a43c-5addb128c5a0" returned: 0 in 0.777s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:21 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ed2af3a3-1f10-44f4-b690-8e8986cde86a tempest-TestStampPattern-1729760105 None] Lock "cinder-quobyte-ee42fb02-6dfc-46bf-a43c-5addb128c5a0" released by "delete_volume" :: held 1.308s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:21 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-ed2af3a3-1f10-44f4-b690-8e8986cde86a tempest-TestStampPattern-1729760105 None] Created reservations ['e2f04a74-eced-4461-b1cf-d31cf0bb7c2a', '44ce1d53-a755-4606-8624-715d03767bbb', 'bd3da866-198f-4357-80ba-20ed5eb6faaf', '328a2fe5-1fa9-4066-a760-0884d7415493'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:50:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ed2af3a3-1f10-44f4-b690-8e8986cde86a tempest-TestStampPattern-1729760105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ed2af3a3-1f10-44f4-b690-8e8986cde86a tempest-TestStampPattern-1729760105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:21 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ed2af3a3-1f10-44f4-b690-8e8986cde86a tempest-TestStampPattern-1729760105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:21 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ed2af3a3-1f10-44f4-b690-8e8986cde86a tempest-TestStampPattern-1729760105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ed2af3a3-1f10-44f4-b690-8e8986cde86a tempest-TestStampPattern-1729760105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ed2af3a3-1f10-44f4-b690-8e8986cde86a tempest-TestStampPattern-1729760105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:21 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:50:21 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:21 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ed2af3a3-1f10-44f4-b690-8e8986cde86a tempest-TestStampPattern-1729760105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.517s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:21 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-ed2af3a3-1f10-44f4-b690-8e8986cde86a tempest-TestStampPattern-1729760105 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:50:21 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-ed2af3a3-1f10-44f4-b690-8e8986cde86a tempest-TestStampPattern-1729760105 None] Deleted volume successfully. Aug 27 03:50:21 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ed2af3a3-1f10-44f4-b690-8e8986cde86a tempest-TestStampPattern-1729760105 None] Lock "cinder-ee42fb02-6dfc-46bf-a43c-5addb128c5a0-delete_volume" released by "delete_volume" :: held 2.198s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:25 devstack sudo[108772]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8f160146-1a74-4627-bb13-46e0934d96ec" returned: 0 in 5.618s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:25 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Image conversion details: src /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec, size 1024.00 MB, duration 5.62 sec, destination /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8f160146-1a74-4627-bb13-46e0934d96ec {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:50:25 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Converted 1024.00 MB image at 182.23 MB/s Aug 27 03:50:25 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8f160146-1a74-4627-bb13-46e0934d96ec is being set with open permissions: ugo+rw Aug 27 03:50:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8f160146-1a74-4627-bb13-46e0934d96ec {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:25 devstack sudo[108803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8f160146-1a74-4627-bb13-46e0934d96ec Aug 27 03:50:25 devstack sudo[108803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:25 devstack sudo[108803]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8f160146-1a74-4627-bb13-46e0934d96ec" returned: 0 in 0.273s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:25 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-quobyte-8f160146-1a74-4627-bb13-46e0934d96ec" released by "_copy_volume_from_snapshot" :: held 6.905s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:25 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-quobyte-3eacf180-adf3-4ce3-b169-b4904a000ec5-8f160146-1a74-4627-bb13-46e0934d96ec" released by "_create_volume_from_snapshot" :: held 6.983s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6ace7cf4-b595-4d5e-96e0-66270179d0ff tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.013s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:25 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-6ace7cf4-b595-4d5e-96e0-66270179d0ff tempest-VolumesSnapshotTestJSON-311548116 None] Creating offline snapshot f4119f0f-906c-4be5-9edc-92195d23c920 of volume 6997b4bd-2343-4815-b00f-da2a0f1d05f3 {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:50:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1abc4ef-2190-4ffd-885e-6c5632df3914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f160146-1a74-4627-bb13-46e0934d96ec', 'volume_size': 1, 'snapshot_id': '3eacf180-adf3-4ce3-b169-b4904a000ec5'}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3fae091-511a-4fde-ae6e-d99daf655e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:25 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dd13ab-24c8-499c-aeca-a8b6e1972a94]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6ace7cf4-b595-4d5e-96e0-66270179d0ff tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:25 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Volume volume-8f160146-1a74-4627-bb13-46e0934d96ec (8f160146-1a74-4627-bb13-46e0934d96ec): created successfully Aug 27 03:50:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3fae091-511a-4fde-ae6e-d99daf655e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Flow 'volume_create_manager' (f25ea49a-c40d-4c88-b744-89629934e808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:50:25 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e356e933-ed3f-4381-87d3-2b1d92772b52 tempest-VolumesDeleteCascade-1695356368 None] Created volume successfully. Aug 27 03:50:25 devstack sudo[108806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3 Aug 27 03:50:25 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "cinder-2e000ad2-025c-4e9e-8048-c704426118ec-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-2e000ad2-025c-4e9e-8048-c704426118ec-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Performing cascade delete. {{(pid=94328) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 27 03:50:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "cinder-3eacf180-adf3-4ce3-b169-b4904a000ec5-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-3eacf180-adf3-4ce3-b169-b4904a000ec5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:26 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6ace7cf4-b595-4d5e-96e0-66270179d0ff tempest-VolumesSnapshotTestJSON-311548116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3" returned: 0 in 0.586s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6ace7cf4-b595-4d5e-96e0-66270179d0ff tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.f4119f0f-906c-4be5-9edc-92195d23c920 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:26 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.f4119f0f-906c-4be5-9edc-92195d23c920 1G Aug 27 03:50:26 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "cinder-quobyte-2e000ad2-025c-4e9e-8048-c704426118ec" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-quobyte-2e000ad2-025c-4e9e-8048-c704426118ec" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "cinder-quobyte-3eacf180-adf3-4ce3-b169-b4904a000ec5" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-quobyte-3eacf180-adf3-4ce3-b169-b4904a000ec5" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:26 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Deleting offline snapshot 3eacf180-adf3-4ce3-b169-b4904a000ec5 of volume 2e000ad2-025c-4e9e-8048-c704426118ec {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:50:26 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] snapshot_file for this snap is: volume-2e000ad2-025c-4e9e-8048-c704426118ec.3eacf180-adf3-4ce3-b169-b4904a000ec5 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:50:26 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[be490fc7-efc1-46bf-83e7-c3ca0d370e9a]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.3eacf180-adf3-4ce3-b169-b4904a000ec5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:26 devstack sudo[108814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.3eacf180-adf3-4ce3-b169-b4904a000ec5 Aug 27 03:50:26 devstack sudo[108814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:26 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6ace7cf4-b595-4d5e-96e0-66270179d0ff tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.f4119f0f-906c-4be5-9edc-92195d23c920 1G" returned: 0 in 0.551s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6ace7cf4-b595-4d5e-96e0-66270179d0ff tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.f4119f0f-906c-4be5-9edc-92195d23c920 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:26 devstack sudo[108823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.f4119f0f-906c-4be5-9edc-92195d23c920 Aug 27 03:50:26 devstack sudo[108823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:27 devstack sudo[108814]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.3eacf180-adf3-4ce3-b169-b4904a000ec5" returned: 0 in 0.479s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e000ad2-025c-4e9e-8048-c704426118ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:50:27 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[5206982f-3a24-4fc9-b053-4c88d522b522]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:27 devstack sudo[108825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec Aug 27 03:50:27 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:27 devstack sudo[108823]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6ace7cf4-b595-4d5e-96e0-66270179d0ff tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.f4119f0f-906c-4be5-9edc-92195d23c920" returned: 0 in 0.379s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:27 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-6ace7cf4-b595-4d5e-96e0-66270179d0ff tempest-VolumesSnapshotTestJSON-311548116 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.f4119f0f-906c-4be5-9edc-92195d23c920 is being set with open permissions: ugo+rw Aug 27 03:50:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6ace7cf4-b595-4d5e-96e0-66270179d0ff tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.f4119f0f-906c-4be5-9edc-92195d23c920 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:27 devstack sudo[108830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.f4119f0f-906c-4be5-9edc-92195d23c920 Aug 27 03:50:27 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:27 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6ace7cf4-b595-4d5e-96e0-66270179d0ff tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.f4119f0f-906c-4be5-9edc-92195d23c920" returned: 0 in 0.279s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6ace7cf4-b595-4d5e-96e0-66270179d0ff tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:27 devstack sudo[108835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.info Aug 27 03:50:27 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:27 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec" returned: 0 in 0.696s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.3eacf180-adf3-4ce3-b169-b4904a000ec5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:27 devstack sudo[108838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.3eacf180-adf3-4ce3-b169-b4904a000ec5 Aug 27 03:50:27 devstack sudo[108838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:27 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6ace7cf4-b595-4d5e-96e0-66270179d0ff tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.info" returned: 0 in 0.308s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:28 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-6ace7cf4-b595-4d5e-96e0-66270179d0ff tempest-VolumesSnapshotTestJSON-311548116 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.info is being set with open permissions: ugo+rw Aug 27 03:50:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6ace7cf4-b595-4d5e-96e0-66270179d0ff tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:28 devstack sudo[108841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.info Aug 27 03:50:28 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:28 devstack sudo[108838]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.3eacf180-adf3-4ce3-b169-b4904a000ec5" returned: 0 in 0.429s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.3eacf180-adf3-4ce3-b169-b4904a000ec5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:28 devstack sudo[108847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.3eacf180-adf3-4ce3-b169-b4904a000ec5 Aug 27 03:50:28 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:28 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6ace7cf4-b595-4d5e-96e0-66270179d0ff tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.info" returned: 0 in 0.288s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6ace7cf4-b595-4d5e-96e0-66270179d0ff tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.550s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:28 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-6ace7cf4-b595-4d5e-96e0-66270179d0ff tempest-VolumesSnapshotTestJSON-311548116 None] Create snapshot completed successfully Aug 27 03:50:28 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec.3eacf180-adf3-4ce3-b169-b4904a000ec5" returned: 0 in 0.274s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-quobyte-3eacf180-adf3-4ce3-b169-b4904a000ec5" released by "_delete_snapshot" :: held 2.015s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-quobyte-2e000ad2-025c-4e9e-8048-c704426118ec" released by "delete_snapshot" :: held 2.049s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:28 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Created reservations ['a0239612-19b0-4ea1-b078-16b9969eafcb', 'f8786557-b842-4650-94fb-3348cee1d994', '9f1833af-850a-4b46-b996-4f885b87ff17', 'a8c58471-5909-4128-b1e7-4967801395e6'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:50:28 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Delete snapshot completed successfully. Aug 27 03:50:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-3eacf180-adf3-4ce3-b169-b4904a000ec5-delete_snapshot" released by "delete_snapshot" :: held 2.294s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Snapshots deleted, issuing volume delete {{(pid=94328) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 27 03:50:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "cinder-quobyte-2e000ad2-025c-4e9e-8048-c704426118ec" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-quobyte-2e000ad2-025c-4e9e-8048-c704426118ec" acquired by "delete_volume" :: waited 0.033s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:28 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[da70f3dc-da91-45f4-b061-582cb3fdb48f]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:28 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec Aug 27 03:50:28 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:29 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec" returned: 0 in 0.490s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:29 devstack sudo[108856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec Aug 27 03:50:29 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:29 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2e000ad2-025c-4e9e-8048-c704426118ec" returned: 0 in 0.333s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-quobyte-2e000ad2-025c-4e9e-8048-c704426118ec" released by "delete_volume" :: held 0.949s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:29 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Created reservations ['446278ea-fc33-4f18-8f04-5426dfee3ba7', 'cb075f29-82ce-4860-9cd6-e7ac08c5714b', '9cacbfd7-c429-4e58-92fd-aa3f9c284a8a', '5768603e-e607-44b6-a4d9-353678cbd3e7'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:30 devstack sudo[108860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:50:30 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Flow 'volume_create_manager' (0ebf2927-32dc-4285-abc9-099e91a8c68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e2f20b-315c-410d-a913-b76276a9be59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e2f20b-315c-410d-a913-b76276a9be59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-114462681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc40bd90-6674-4713-9dc6-d1e0b0f4877c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='983c4a98a134460ea1a6b9c2c63ae559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f4119f0f-906c-4be5-9edc-92195d23c920,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:50:30Z,use_quota=True,user_id='87c149b133bc476da1c8f28fe31dd267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06763f14-0ff6-4d6d-8b6b-19653f51444a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06763f14-0ff6-4d6d-8b6b-19653f51444a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e5577f-14b8-4f07-8ea2-31476fccc910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e5577f-14b8-4f07-8ea2-31476fccc910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bc40bd90-6674-4713-9dc6-d1e0b0f4877c', 'volume_name': 'volume-bc40bd90-6674-4713-9dc6-d1e0b0f4877c', 'volume_size': 1, 'snapshot_id': 'f4119f0f-906c-4be5-9edc-92195d23c920'}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:30 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4d6ded-f13c-4010-84dd-5453c60a72ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4d6ded-f13c-4010-84dd-5453c60a72ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97e9166-c9bd-4c58-9f22-4972675299c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:30 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Volume bc40bd90-6674-4713-9dc6-d1e0b0f4877c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bc40bd90-6674-4713-9dc6-d1e0b0f4877c', 'volume_size': 1, 'snapshot_id': 'f4119f0f-906c-4be5-9edc-92195d23c920'} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.338s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:50:30 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Deleted volume successfully. Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "cinder-quobyte-f4119f0f-906c-4be5-9edc-92195d23c920-bc40bd90-6674-4713-9dc6-d1e0b0f4877c" by "_create_volume_from_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5d7fd6b4-82a7-45c2-89a1-ce6fcf3eba55 tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-2e000ad2-025c-4e9e-8048-c704426118ec-delete_volume" released by "delete_volume" :: held 4.115s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-f4119f0f-906c-4be5-9edc-92195d23c920-bc40bd90-6674-4713-9dc6-d1e0b0f4877c" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Creating volume bc40bd90-6674-4713-9dc6-d1e0b0f4877c from snapshot f4119f0f-906c-4be5-9edc-92195d23c920 {{(pid=94328) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "cinder-quobyte-bc40bd90-6674-4713-9dc6-d1e0b0f4877c" by "_copy_volume_from_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-bc40bd90-6674-4713-9dc6-d1e0b0f4877c" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] snapshot: f4119f0f-906c-4be5-9edc-92195d23c920, volume: bc40bd90-6674-4713-9dc6-d1e0b0f4877c, {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b87d2e-bc3f-4f55-9fe0-45c5668e6918]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.f4119f0f-906c-4be5-9edc-92195d23c920 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:30 devstack sudo[108863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.f4119f0f-906c-4be5-9edc-92195d23c920 Aug 27 03:50:30 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-196c7290-7a43-4f69-a71f-89e37f0e0e70 tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "cinder-8f160146-1a74-4627-bb13-46e0934d96ec-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-196c7290-7a43-4f69-a71f-89e37f0e0e70 tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-8f160146-1a74-4627-bb13-46e0934d96ec-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:31 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-196c7290-7a43-4f69-a71f-89e37f0e0e70 tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "cinder-quobyte-8f160146-1a74-4627-bb13-46e0934d96ec" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.f4119f0f-906c-4be5-9edc-92195d23c920" returned: 0 in 0.518s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:31 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:50:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-196c7290-7a43-4f69-a71f-89e37f0e0e70 tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-quobyte-8f160146-1a74-4627-bb13-46e0934d96ec" acquired by "delete_volume" :: waited 0.024s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:31 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[52134492-760d-4439-b514-93fa604e90c0]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:31 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[11124013-8ae6-4f8d-85dc-49db60e9f455]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-196c7290-7a43-4f69-a71f-89e37f0e0e70 tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8f160146-1a74-4627-bb13-46e0934d96ec {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:31 devstack sudo[108869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3 Aug 27 03:50:31 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:31 devstack sudo[108870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8f160146-1a74-4627-bb13-46e0934d96ec Aug 27 03:50:31 devstack sudo[108870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:31 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3" returned: 0 in 0.449s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:31 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] will copy from snapshot at /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3 {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 27 03:50:31 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Creating direct copy from snapshot {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 27 03:50:31 devstack cinder-volume[94328]: DEBUG cinder.utils [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Path /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc40bd90-6674-4713-9dc6-d1e0b0f4877c not found in is_blk_device check {{(pid=94328) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 27 03:50:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc40bd90-6674-4713-9dc6-d1e0b0f4877c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:31 devstack sudo[108878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc40bd90-6674-4713-9dc6-d1e0b0f4877c Aug 27 03:50:31 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:31 devstack sudo[108870]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-196c7290-7a43-4f69-a71f-89e37f0e0e70 tempest-VolumesDeleteCascade-1695356368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8f160146-1a74-4627-bb13-46e0934d96ec" returned: 0 in 0.500s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-196c7290-7a43-4f69-a71f-89e37f0e0e70 tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8f160146-1a74-4627-bb13-46e0934d96ec {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:31 devstack sudo[108882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8f160146-1a74-4627-bb13-46e0934d96ec Aug 27 03:50:31 devstack sudo[108882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:31 devstack sudo[108882]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-196c7290-7a43-4f69-a71f-89e37f0e0e70 tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8f160146-1a74-4627-bb13-46e0934d96ec" returned: 0 in 0.288s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-196c7290-7a43-4f69-a71f-89e37f0e0e70 tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-quobyte-8f160146-1a74-4627-bb13-46e0934d96ec" released by "delete_volume" :: held 0.893s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:32 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-196c7290-7a43-4f69-a71f-89e37f0e0e70 tempest-VolumesDeleteCascade-1695356368 None] Created reservations ['ec5381d4-adc9-4d2b-9a70-c80232241a1d', '8eb01c25-2a72-4caa-a1f8-f6b6f0520001', '934c2792-657f-43fa-84f5-7f24fd18d484', 'fc19f3d5-4aa0-44bd-bca2-e994b71f7640'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:50:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-196c7290-7a43-4f69-a71f-89e37f0e0e70 tempest-VolumesDeleteCascade-1695356368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-196c7290-7a43-4f69-a71f-89e37f0e0e70 tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-196c7290-7a43-4f69-a71f-89e37f0e0e70 tempest-VolumesDeleteCascade-1695356368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-196c7290-7a43-4f69-a71f-89e37f0e0e70 tempest-VolumesDeleteCascade-1695356368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-196c7290-7a43-4f69-a71f-89e37f0e0e70 tempest-VolumesDeleteCascade-1695356368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-196c7290-7a43-4f69-a71f-89e37f0e0e70 tempest-VolumesDeleteCascade-1695356368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:32 devstack sudo[108890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:50:32 devstack sudo[108890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:32 devstack sudo[108890]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-196c7290-7a43-4f69-a71f-89e37f0e0e70 tempest-VolumesDeleteCascade-1695356368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.713s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:32 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-196c7290-7a43-4f69-a71f-89e37f0e0e70 tempest-VolumesDeleteCascade-1695356368 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:50:33 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-196c7290-7a43-4f69-a71f-89e37f0e0e70 tempest-VolumesDeleteCascade-1695356368 None] Deleted volume successfully. Aug 27 03:50:33 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=148,cinder:INSERT=42,cinder:UPDATE=188,cinder:DELETE=15 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:50:33 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-196c7290-7a43-4f69-a71f-89e37f0e0e70 tempest-VolumesDeleteCascade-1695356368 None] Lock "cinder-8f160146-1a74-4627-bb13-46e0934d96ec-delete_volume" released by "delete_volume" :: held 2.156s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:37 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc40bd90-6674-4713-9dc6-d1e0b0f4877c" returned: 0 in 5.712s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:37 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Image conversion details: src /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3, size 1024.00 MB, duration 5.71 sec, destination /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc40bd90-6674-4713-9dc6-d1e0b0f4877c {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:50:37 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Converted 1024.00 MB image at 179.25 MB/s Aug 27 03:50:37 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc40bd90-6674-4713-9dc6-d1e0b0f4877c is being set with open permissions: ugo+rw Aug 27 03:50:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc40bd90-6674-4713-9dc6-d1e0b0f4877c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:37 devstack sudo[108901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc40bd90-6674-4713-9dc6-d1e0b0f4877c Aug 27 03:50:37 devstack sudo[108901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:37 devstack sudo[108901]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc40bd90-6674-4713-9dc6-d1e0b0f4877c" returned: 0 in 0.269s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-bc40bd90-6674-4713-9dc6-d1e0b0f4877c" released by "_copy_volume_from_snapshot" :: held 7.092s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:37 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=170,cinder:INSERT=50,cinder:UPDATE=170,cinder:DELETE=14 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:50:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-f4119f0f-906c-4be5-9edc-92195d23c920-bc40bd90-6674-4713-9dc6-d1e0b0f4877c" released by "_create_volume_from_snapshot" :: held 7.195s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.231s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:37 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97e9166-c9bd-4c58-9f22-4972675299c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc40bd90-6674-4713-9dc6-d1e0b0f4877c', 'volume_size': 1, 'snapshot_id': 'f4119f0f-906c-4be5-9edc-92195d23c920'}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:37 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e307a9ba-17eb-4ffc-a3ad-e01f9cdf16c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:37 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Volume volume-bc40bd90-6674-4713-9dc6-d1e0b0f4877c (bc40bd90-6674-4713-9dc6-d1e0b0f4877c): created successfully Aug 27 03:50:37 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e307a9ba-17eb-4ffc-a3ad-e01f9cdf16c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:37 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Flow 'volume_create_manager' (0ebf2927-32dc-4285-abc9-099e91a8c68b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:50:37 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-0d066dc1-8d9d-4931-bf19-852391a00e88 tempest-VolumesSnapshotTestJSON-311548116 None] Created volume successfully. Aug 27 03:50:38 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b2255df6-f8cf-47be-b553-86fc94be9289 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "cinder-bc40bd90-6674-4713-9dc6-d1e0b0f4877c-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:38 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b2255df6-f8cf-47be-b553-86fc94be9289 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-bc40bd90-6674-4713-9dc6-d1e0b0f4877c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:38 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b2255df6-f8cf-47be-b553-86fc94be9289 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "cinder-quobyte-bc40bd90-6674-4713-9dc6-d1e0b0f4877c" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:38 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b2255df6-f8cf-47be-b553-86fc94be9289 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-bc40bd90-6674-4713-9dc6-d1e0b0f4877c" acquired by "delete_volume" :: waited 0.025s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:38 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[82325dee-f86d-4f94-92e7-950bc37e64fe]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b2255df6-f8cf-47be-b553-86fc94be9289 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc40bd90-6674-4713-9dc6-d1e0b0f4877c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:38 devstack sudo[108906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc40bd90-6674-4713-9dc6-d1e0b0f4877c Aug 27 03:50:38 devstack sudo[108906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:38 devstack sudo[108906]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b2255df6-f8cf-47be-b553-86fc94be9289 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc40bd90-6674-4713-9dc6-d1e0b0f4877c" returned: 0 in 0.564s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b2255df6-f8cf-47be-b553-86fc94be9289 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc40bd90-6674-4713-9dc6-d1e0b0f4877c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:38 devstack sudo[108912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc40bd90-6674-4713-9dc6-d1e0b0f4877c Aug 27 03:50:38 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:39 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b2255df6-f8cf-47be-b553-86fc94be9289 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bc40bd90-6674-4713-9dc6-d1e0b0f4877c" returned: 0 in 0.368s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:39 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b2255df6-f8cf-47be-b553-86fc94be9289 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-bc40bd90-6674-4713-9dc6-d1e0b0f4877c" released by "delete_volume" :: held 1.006s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:39 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-b2255df6-f8cf-47be-b553-86fc94be9289 tempest-VolumesSnapshotTestJSON-311548116 None] Created reservations ['6419e451-a40e-448e-8057-1f443d3edb5d', '8704c28b-7f37-4dab-b0dc-05d33938d39b', '74de838f-8805-45f3-83f1-f12a4f1ec628', 'ba7c363c-b746-4812-ab56-440f89a1a19c'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:50:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b2255df6-f8cf-47be-b553-86fc94be9289 tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b2255df6-f8cf-47be-b553-86fc94be9289 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:39 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b2255df6-f8cf-47be-b553-86fc94be9289 tempest-VolumesSnapshotTestJSON-311548116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:39 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b2255df6-f8cf-47be-b553-86fc94be9289 tempest-VolumesSnapshotTestJSON-311548116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b2255df6-f8cf-47be-b553-86fc94be9289 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b2255df6-f8cf-47be-b553-86fc94be9289 tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:39 devstack sudo[108915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:50:39 devstack sudo[108915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:39 devstack sudo[108915]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b2255df6-f8cf-47be-b553-86fc94be9289 tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.272s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:39 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-b2255df6-f8cf-47be-b553-86fc94be9289 tempest-VolumesSnapshotTestJSON-311548116 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:50:39 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-b2255df6-f8cf-47be-b553-86fc94be9289 tempest-VolumesSnapshotTestJSON-311548116 None] Deleted volume successfully. Aug 27 03:50:39 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b2255df6-f8cf-47be-b553-86fc94be9289 tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-bc40bd90-6674-4713-9dc6-d1e0b0f4877c-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:40 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:50:40 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Flow 'volume_create_manager' (c9cfef84-3176-4237-b964-2613ab06c71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:50:40 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9a8ef6-3789-47af-9d02-a691da8bc5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:40 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9a8ef6-3789-47af-9d02-a691da8bc5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1420231095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09f961ef-8340-4097-92c0-19ac115a4eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334d987971a14575ab6b93c3685cd5df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:50:41Z,use_quota=True,user_id='f6395e98d21340f2a8386225c0b1ee7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:40 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b93c09-23e5-4180-b74b-73ad0e01dadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:40 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b93c09-23e5-4180-b74b-73ad0e01dadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:40 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a122b80-8794-4771-8da2-b974f66e9113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:40 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a122b80-8794-4771-8da2-b974f66e9113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09f961ef-8340-4097-92c0-19ac115a4eb9', 'volume_name': 'volume-09f961ef-8340-4097-92c0-19ac115a4eb9', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:40 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f76e0ed3-90db-45a9-855b-387ace5155b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:40 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f76e0ed3-90db-45a9-855b-387ace5155b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:40 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c86acb-12f1-4478-8599-58fcbcbfc7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:40 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Volume 09f961ef-8340-4097-92c0-19ac115a4eb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09f961ef-8340-4097-92c0-19ac115a4eb9', 'volume_size': 1} Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1420231095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09f961ef-8340-4097-92c0-19ac115a4eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334d987971a14575ab6b93c3685cd5df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:50:41Z,use_quota=True,user_id='f6395e98d21340f2a8386225c0b1ee7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Creating volume 09f961ef-8340-4097-92c0-19ac115a4eb9 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:50:41 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-09f961ef-8340-4097-92c0-19ac115a4eb9 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8d6e3fa6-b072-4208-a88f-11cb60c231cf tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "cinder-f4119f0f-906c-4be5-9edc-92195d23c920-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:41 devstack sudo[108919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-09f961ef-8340-4097-92c0-19ac115a4eb9 1073741824 Aug 27 03:50:41 devstack sudo[108919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8d6e3fa6-b072-4208-a88f-11cb60c231cf tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-f4119f0f-906c-4be5-9edc-92195d23c920-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8d6e3fa6-b072-4208-a88f-11cb60c231cf tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "cinder-quobyte-6997b4bd-2343-4815-b00f-da2a0f1d05f3" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8d6e3fa6-b072-4208-a88f-11cb60c231cf tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-6997b4bd-2343-4815-b00f-da2a0f1d05f3" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8d6e3fa6-b072-4208-a88f-11cb60c231cf tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "cinder-quobyte-f4119f0f-906c-4be5-9edc-92195d23c920" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8d6e3fa6-b072-4208-a88f-11cb60c231cf tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-f4119f0f-906c-4be5-9edc-92195d23c920" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-8d6e3fa6-b072-4208-a88f-11cb60c231cf tempest-VolumesSnapshotTestJSON-311548116 None] Deleting offline snapshot f4119f0f-906c-4be5-9edc-92195d23c920 of volume 6997b4bd-2343-4815-b00f-da2a0f1d05f3 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-8d6e3fa6-b072-4208-a88f-11cb60c231cf tempest-VolumesSnapshotTestJSON-311548116 None] snapshot_file for this snap is: volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.f4119f0f-906c-4be5-9edc-92195d23c920 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[84477d28-2a0f-4cab-aa87-3916a3940a51]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8d6e3fa6-b072-4208-a88f-11cb60c231cf tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.f4119f0f-906c-4be5-9edc-92195d23c920 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:41 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.f4119f0f-906c-4be5-9edc-92195d23c920 Aug 27 03:50:41 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:41 devstack sudo[108919]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-09f961ef-8340-4097-92c0-19ac115a4eb9 1073741824" returned: 0 in 0.600s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:41 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8d6e3fa6-b072-4208-a88f-11cb60c231cf tempest-VolumesSnapshotTestJSON-311548116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.f4119f0f-906c-4be5-9edc-92195d23c920" returned: 0 in 0.470s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-8d6e3fa6-b072-4208-a88f-11cb60c231cf tempest-VolumesSnapshotTestJSON-311548116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-09f961ef-8340-4097-92c0-19ac115a4eb9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[784331b5-9845-4666-b56c-666a362f2ace]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8d6e3fa6-b072-4208-a88f-11cb60c231cf tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:41 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-09f961ef-8340-4097-92c0-19ac115a4eb9 Aug 27 03:50:41 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:41 devstack sudo[108932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3 Aug 27 03:50:41 devstack sudo[108932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:42 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-09f961ef-8340-4097-92c0-19ac115a4eb9" returned: 0 in 0.367s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:42 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:50:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c86acb-12f1-4478-8599-58fcbcbfc7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09f961ef-8340-4097-92c0-19ac115a4eb9', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a4b8b0-daec-4279-9221-70bb2dac666f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:42 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Volume volume-09f961ef-8340-4097-92c0-19ac115a4eb9 (09f961ef-8340-4097-92c0-19ac115a4eb9): created successfully Aug 27 03:50:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a4b8b0-daec-4279-9221-70bb2dac666f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Flow 'volume_create_manager' (c9cfef84-3176-4237-b964-2613ab06c71f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:50:42 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-83f1134b-b4f1-4dad-988a-a306b021a1db tempest-VolumesMetadataTest-169917385 None] Created volume successfully. Aug 27 03:50:42 devstack sudo[108932]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8d6e3fa6-b072-4208-a88f-11cb60c231cf tempest-VolumesSnapshotTestJSON-311548116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3" returned: 0 in 0.836s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8d6e3fa6-b072-4208-a88f-11cb60c231cf tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.f4119f0f-906c-4be5-9edc-92195d23c920 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:42 devstack sudo[108940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.f4119f0f-906c-4be5-9edc-92195d23c920 Aug 27 03:50:42 devstack sudo[108940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Flow 'volume_create_manager' (a5e7da26-283a-4475-8cfa-a7ad54f551fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ff2072-f06a-402b-9ec9-b761e9721a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:43 devstack sudo[108940]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8d6e3fa6-b072-4208-a88f-11cb60c231cf tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.f4119f0f-906c-4be5-9edc-92195d23c920" returned: 0 in 0.647s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8d6e3fa6-b072-4208-a88f-11cb60c231cf tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.f4119f0f-906c-4be5-9edc-92195d23c920 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ff2072-f06a-402b-9ec9-b761e9721a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1149823190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='632685666c734bc8ba633b7986bbf934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:50:43Z,use_quota=True,user_id='22a1ed4609634366977a5871e0fd250c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf3305a-d91a-40b2-bfbe-4387e24ff3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:43 devstack sudo[108946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.f4119f0f-906c-4be5-9edc-92195d23c920 Aug 27 03:50:43 devstack sudo[108946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf3305a-d91a-40b2-bfbe-4387e24ff3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05fdafb2-ac24-4c28-962a-b4a1f9c375f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05fdafb2-ac24-4c28-962a-b4a1f9c375f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3', 'volume_name': 'volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c25cd3-6610-4f97-9628-92342a6dcaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c25cd3-6610-4f97-9628-92342a6dcaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b7b7b6-55d4-4e4e-9367-0533f3cb1fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:43 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Volume c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3', 'volume_size': 1} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1149823190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='632685666c734bc8ba633b7986bbf934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:50:43Z,use_quota=True,user_id='22a1ed4609634366977a5871e0fd250c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Creating volume c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:50:43 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:43 devstack sudo[108948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 1073741824 Aug 27 03:50:43 devstack sudo[108948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:43 devstack sudo[108946]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8d6e3fa6-b072-4208-a88f-11cb60c231cf tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3.f4119f0f-906c-4be5-9edc-92195d23c920" returned: 0 in 0.357s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8d6e3fa6-b072-4208-a88f-11cb60c231cf tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-f4119f0f-906c-4be5-9edc-92195d23c920" released by "_delete_snapshot" :: held 2.484s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8d6e3fa6-b072-4208-a88f-11cb60c231cf tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-6997b4bd-2343-4815-b00f-da2a0f1d05f3" released by "delete_snapshot" :: held 2.527s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-8d6e3fa6-b072-4208-a88f-11cb60c231cf tempest-VolumesSnapshotTestJSON-311548116 None] Created reservations ['da4e9217-f9b3-40cc-b814-43132839240e', 'eb31bb5e-b9b6-49d6-9331-b1ad10e060c8', '19a60c15-c445-4d40-810d-657987b3ebe9', 'c53ccd39-c46f-4563-a5d6-3109424a1e58'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:50:43 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-8d6e3fa6-b072-4208-a88f-11cb60c231cf tempest-VolumesSnapshotTestJSON-311548116 None] Delete snapshot completed successfully. Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8d6e3fa6-b072-4208-a88f-11cb60c231cf tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-f4119f0f-906c-4be5-9edc-92195d23c920-delete_snapshot" released by "delete_snapshot" :: held 2.756s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8da9d341-16ed-4328-bfba-6f0d54a34ad8 tempest-VolumesMetadataTest-169917385 None] Acquiring lock "cinder-09f961ef-8340-4097-92c0-19ac115a4eb9-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8da9d341-16ed-4328-bfba-6f0d54a34ad8 tempest-VolumesMetadataTest-169917385 None] Lock "cinder-09f961ef-8340-4097-92c0-19ac115a4eb9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8da9d341-16ed-4328-bfba-6f0d54a34ad8 tempest-VolumesMetadataTest-169917385 None] Acquiring lock "cinder-quobyte-09f961ef-8340-4097-92c0-19ac115a4eb9" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8da9d341-16ed-4328-bfba-6f0d54a34ad8 tempest-VolumesMetadataTest-169917385 None] Lock "cinder-quobyte-09f961ef-8340-4097-92c0-19ac115a4eb9" acquired by "delete_volume" :: waited 0.025s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb1f0c2-b075-4a44-a5e7-e1051c2e68a7]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:44 devstack sudo[108948]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8da9d341-16ed-4328-bfba-6f0d54a34ad8 tempest-VolumesMetadataTest-169917385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-09f961ef-8340-4097-92c0-19ac115a4eb9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 1073741824" returned: 0 in 0.693s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:44 devstack sudo[108956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 Aug 27 03:50:44 devstack sudo[108956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:44 devstack sudo[108955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-09f961ef-8340-4097-92c0-19ac115a4eb9 Aug 27 03:50:44 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b33e2b7a-ca1c-4d73-8b88-160390f49bbc tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "cinder-6997b4bd-2343-4815-b00f-da2a0f1d05f3-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b33e2b7a-ca1c-4d73-8b88-160390f49bbc tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-6997b4bd-2343-4815-b00f-da2a0f1d05f3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:44 devstack sudo[108956]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3" returned: 0 in 0.275s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b7b7b6-55d4-4e4e-9367-0533f3cb1fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324998b8-574e-42e5-b578-34a411d36964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b33e2b7a-ca1c-4d73-8b88-160390f49bbc tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "cinder-quobyte-6997b4bd-2343-4815-b00f-da2a0f1d05f3" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:44 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Volume volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 (c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3): created successfully Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324998b8-574e-42e5-b578-34a411d36964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Flow 'volume_create_manager' (a5e7da26-283a-4475-8cfa-a7ad54f551fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b33e2b7a-ca1c-4d73-8b88-160390f49bbc tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-6997b4bd-2343-4815-b00f-da2a0f1d05f3" acquired by "delete_volume" :: waited 0.034s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:44 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:44 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-109064f9-5d63-4f68-922f-438178268c3e tempest-VolumesActionsTest-1878717002 None] Created volume successfully. Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8da9d341-16ed-4328-bfba-6f0d54a34ad8 tempest-VolumesMetadataTest-169917385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-09f961ef-8340-4097-92c0-19ac115a4eb9" returned: 0 in 0.473s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8da9d341-16ed-4328-bfba-6f0d54a34ad8 tempest-VolumesMetadataTest-169917385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-09f961ef-8340-4097-92c0-19ac115a4eb9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b89edcd-d221-4461-a482-30ea26ffd848]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b33e2b7a-ca1c-4d73-8b88-160390f49bbc tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:44 devstack sudo[108963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-09f961ef-8340-4097-92c0-19ac115a4eb9 Aug 27 03:50:44 devstack sudo[108963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:44 devstack sudo[108964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3 Aug 27 03:50:44 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:44 devstack sudo[108963]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8da9d341-16ed-4328-bfba-6f0d54a34ad8 tempest-VolumesMetadataTest-169917385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-09f961ef-8340-4097-92c0-19ac115a4eb9" returned: 0 in 0.252s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8da9d341-16ed-4328-bfba-6f0d54a34ad8 tempest-VolumesMetadataTest-169917385 None] Lock "cinder-quobyte-09f961ef-8340-4097-92c0-19ac115a4eb9" released by "delete_volume" :: held 0.776s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-8da9d341-16ed-4328-bfba-6f0d54a34ad8 tempest-VolumesMetadataTest-169917385 None] Created reservations ['cecbac38-d0f4-4c89-80fb-172588080c33', '89d13f9d-9be5-4627-a72f-3d32c3184316', 'd98ec05c-eb79-4115-b1aa-ab7fb97a2661', 'f9422d68-31f7-4927-9765-fdd6955c575f'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8da9d341-16ed-4328-bfba-6f0d54a34ad8 tempest-VolumesMetadataTest-169917385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8da9d341-16ed-4328-bfba-6f0d54a34ad8 tempest-VolumesMetadataTest-169917385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8da9d341-16ed-4328-bfba-6f0d54a34ad8 tempest-VolumesMetadataTest-169917385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8da9d341-16ed-4328-bfba-6f0d54a34ad8 tempest-VolumesMetadataTest-169917385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8da9d341-16ed-4328-bfba-6f0d54a34ad8 tempest-VolumesMetadataTest-169917385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8da9d341-16ed-4328-bfba-6f0d54a34ad8 tempest-VolumesMetadataTest-169917385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:44 devstack sudo[108972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:50:44 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:44 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b33e2b7a-ca1c-4d73-8b88-160390f49bbc tempest-VolumesSnapshotTestJSON-311548116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3" returned: 0 in 0.423s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b33e2b7a-ca1c-4d73-8b88-160390f49bbc tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:44 devstack sudo[108974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3 Aug 27 03:50:44 devstack sudo[108974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:45 devstack sudo[108974]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b33e2b7a-ca1c-4d73-8b88-160390f49bbc tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6997b4bd-2343-4815-b00f-da2a0f1d05f3" returned: 0 in 0.299s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:45 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8da9d341-16ed-4328-bfba-6f0d54a34ad8 tempest-VolumesMetadataTest-169917385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.366s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:45 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-8da9d341-16ed-4328-bfba-6f0d54a34ad8 tempest-VolumesMetadataTest-169917385 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:50:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b33e2b7a-ca1c-4d73-8b88-160390f49bbc tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-6997b4bd-2343-4815-b00f-da2a0f1d05f3" released by "delete_volume" :: held 0.813s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:45 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-8da9d341-16ed-4328-bfba-6f0d54a34ad8 tempest-VolumesMetadataTest-169917385 None] Deleted volume successfully. Aug 27 03:50:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8da9d341-16ed-4328-bfba-6f0d54a34ad8 tempest-VolumesMetadataTest-169917385 None] Lock "cinder-09f961ef-8340-4097-92c0-19ac115a4eb9-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:45 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-b33e2b7a-ca1c-4d73-8b88-160390f49bbc tempest-VolumesSnapshotTestJSON-311548116 None] Created reservations ['4f9efcfa-a51f-4fcf-9726-244f8d230b60', '55ea4d7c-2090-4704-a90b-bef457e3d323', '44aa2964-8470-4c22-8d68-fccdac077e0e', 'f47638ec-56f9-42f4-b663-60b61a30db43'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:50:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b33e2b7a-ca1c-4d73-8b88-160390f49bbc tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b33e2b7a-ca1c-4d73-8b88-160390f49bbc tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:45 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b33e2b7a-ca1c-4d73-8b88-160390f49bbc tempest-VolumesSnapshotTestJSON-311548116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:45 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b33e2b7a-ca1c-4d73-8b88-160390f49bbc tempest-VolumesSnapshotTestJSON-311548116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b33e2b7a-ca1c-4d73-8b88-160390f49bbc tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b33e2b7a-ca1c-4d73-8b88-160390f49bbc tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:45 devstack sudo[108978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:50:45 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-72c11d7d-8f11-44d7-972e-65374b91be7b tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "cinder-20adb79b-487f-4d5e-af5e-05328e2c5c6d-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-72c11d7d-8f11-44d7-972e-65374b91be7b tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-20adb79b-487f-4d5e-af5e-05328e2c5c6d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-72c11d7d-8f11-44d7-972e-65374b91be7b tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "cinder-quobyte-20adb79b-487f-4d5e-af5e-05328e2c5c6d" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-72c11d7d-8f11-44d7-972e-65374b91be7b tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-20adb79b-487f-4d5e-af5e-05328e2c5c6d" acquired by "delete_volume" :: waited 0.025s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:45 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b33e2b7a-ca1c-4d73-8b88-160390f49bbc tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.428s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:45 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-b33e2b7a-ca1c-4d73-8b88-160390f49bbc tempest-VolumesSnapshotTestJSON-311548116 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:50:45 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ead96ee-5a94-4297-9b8e-3ca614bb093d]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-72c11d7d-8f11-44d7-972e-65374b91be7b tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:45 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-b33e2b7a-ca1c-4d73-8b88-160390f49bbc tempest-VolumesSnapshotTestJSON-311548116 None] Deleted volume successfully. Aug 27 03:50:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b33e2b7a-ca1c-4d73-8b88-160390f49bbc tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-6997b4bd-2343-4815-b00f-da2a0f1d05f3-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:46 devstack sudo[108981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d Aug 27 03:50:46 devstack sudo[108981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:46 devstack sudo[108981]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-72c11d7d-8f11-44d7-972e-65374b91be7b tempest-VolumesSnapshotTestJSON-311548116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d" returned: 0 in 0.514s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-72c11d7d-8f11-44d7-972e-65374b91be7b tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:46 devstack sudo[108986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d Aug 27 03:50:46 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:46 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-72c11d7d-8f11-44d7-972e-65374b91be7b tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20adb79b-487f-4d5e-af5e-05328e2c5c6d" returned: 0 in 0.335s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:46 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-72c11d7d-8f11-44d7-972e-65374b91be7b tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-quobyte-20adb79b-487f-4d5e-af5e-05328e2c5c6d" released by "delete_volume" :: held 0.978s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:46 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-72c11d7d-8f11-44d7-972e-65374b91be7b tempest-VolumesSnapshotTestJSON-311548116 None] Created reservations ['f1af5143-5d78-4311-a190-51860409fdfc', 'd3d9915f-03b7-4f81-8f13-6c09430f963b', 'c04db525-3d8e-43cf-9a34-240cb6634aba', 'ad0f461b-7421-4f76-86b6-662f3cb38924'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:50:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-72c11d7d-8f11-44d7-972e-65374b91be7b tempest-VolumesSnapshotTestJSON-311548116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-72c11d7d-8f11-44d7-972e-65374b91be7b tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:47 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-72c11d7d-8f11-44d7-972e-65374b91be7b tempest-VolumesSnapshotTestJSON-311548116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:47 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-72c11d7d-8f11-44d7-972e-65374b91be7b tempest-VolumesSnapshotTestJSON-311548116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-72c11d7d-8f11-44d7-972e-65374b91be7b tempest-VolumesSnapshotTestJSON-311548116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-72c11d7d-8f11-44d7-972e-65374b91be7b tempest-VolumesSnapshotTestJSON-311548116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:47 devstack sudo[108992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:50:47 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:47 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-72c11d7d-8f11-44d7-972e-65374b91be7b tempest-VolumesSnapshotTestJSON-311548116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.327s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:47 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-72c11d7d-8f11-44d7-972e-65374b91be7b tempest-VolumesSnapshotTestJSON-311548116 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:50:47 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-72c11d7d-8f11-44d7-972e-65374b91be7b tempest-VolumesSnapshotTestJSON-311548116 None] Deleted volume successfully. Aug 27 03:50:47 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-72c11d7d-8f11-44d7-972e-65374b91be7b tempest-VolumesSnapshotTestJSON-311548116 None] Lock "cinder-20adb79b-487f-4d5e-af5e-05328e2c5c6d-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:51 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:50:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Flow 'volume_create_manager' (4b4ec3f0-ea69-4277-8854-4db19e0abc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f20eb19-e0da-4be4-803b-ce43f230a964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f20eb19-e0da-4be4-803b-ce43f230a964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ad2e17c-139e-4ac1-b783-58d70e949d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16b37820a174f78b922922478bedd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:50:52Z,use_quota=True,user_id='ae321af06f2d4b91a7efd38c1ac337f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ba536e-43e7-4e27-aaa1-ef64243d0ba2),volume_type_id=11ba536e-43e7-4e27-aaa1-ef64243d0ba2)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58da0161-bac6-42b8-af9a-30a00eb4184b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58da0161-bac6-42b8-af9a-30a00eb4184b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837faefb-25f4-4d40-98ce-41398f8b7bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.image.glance [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Creating Keystone auth plugin from conf {{(pid=94328) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Flow 'volume_create_manager' (3a723d0a-af1a-4f6e-bb6f-d2dc355b64d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005d18b1-27a2-4ff1-800f-4e27bfd569b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005d18b1-27a2-4ff1-800f-4e27bfd569b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1125015910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cb97681-8f71-45ce-98b1-064c2e37f343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16a6fea230e9482fa817e6c3a58d0aec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:50:52Z,use_quota=True,user_id='ab485411f1334519a7b3b633a1b054f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53766e63-50a9-412d-86cc-0f8d100c417a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53766e63-50a9-412d-86cc-0f8d100c417a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41156733-5223-4a95-a439-945e210f39d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41156733-5223-4a95-a439-945e210f39d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cb97681-8f71-45ce-98b1-064c2e37f343', 'volume_name': 'volume-2cb97681-8f71-45ce-98b1-064c2e37f343', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e98559-6682-41d8-8c36-942cbe4bff0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e98559-6682-41d8-8c36-942cbe4bff0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2d4bcf-7d56-431f-8a59-ba40d21311a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:52 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Volume 2cb97681-8f71-45ce-98b1-064c2e37f343: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cb97681-8f71-45ce-98b1-064c2e37f343', 'volume_size': 1} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1125015910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cb97681-8f71-45ce-98b1-064c2e37f343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16a6fea230e9482fa817e6c3a58d0aec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:50:52Z,use_quota=True,user_id='ab485411f1334519a7b3b633a1b054f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Creating volume 2cb97681-8f71-45ce-98b1-064c2e37f343 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:50:52 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cb97681-8f71-45ce-98b1-064c2e37f343 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:52 devstack sudo[109013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cb97681-8f71-45ce-98b1-064c2e37f343 1073741824 Aug 27 03:50:52 devstack sudo[109013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837faefb-25f4-4d40-98ce-41398f8b7bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3ad2e17c-139e-4ac1-b783-58d70e949d1e', 'volume_name': 'volume-3ad2e17c-139e-4ac1-b783-58d70e949d1e', 'volume_size': 1, 'image_id': '08632b4f-0a47-4b91-94f7-21c9b814162b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08632b4f-0a47-4b91-94f7-21c9b814162b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f616e9c9a9a0dd9e4dc7771bbd96f1a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e16b37820a174f78b922922478bedd80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd077ed34a87e2f47ad5a38dd04183e7cbe9529508ceadb2dac1e11526c7995e7a51733b64c11e21c7d229e5cc4660c73f608f76dd22b48a9096247d0b6a6f3e8', 'id': '08632b4f-0a47-4b91-94f7-21c9b814162b', 'created_at': datetime.datetime(2026, 8, 27, 1, 50, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 50, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08632b4f-0a47-4b91-94f7-21c9b814162b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc5833c-6dc3-42e8-b146-a1768090ba62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc5833c-6dc3-42e8-b146-a1768090ba62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e6aadc-2671-4e5e-ae91-fa60666b970c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:52 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Volume 3ad2e17c-139e-4ac1-b783-58d70e949d1e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3ad2e17c-139e-4ac1-b783-58d70e949d1e', 'volume_size': 1, 'image_id': '08632b4f-0a47-4b91-94f7-21c9b814162b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08632b4f-0a47-4b91-94f7-21c9b814162b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f616e9c9a9a0dd9e4dc7771bbd96f1a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e16b37820a174f78b922922478bedd80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd077ed34a87e2f47ad5a38dd04183e7cbe9529508ceadb2dac1e11526c7995e7a51733b64c11e21c7d229e5cc4660c73f608f76dd22b48a9096247d0b6a6f3e8', 'id': '08632b4f-0a47-4b91-94f7-21c9b814162b', 'created_at': datetime.datetime(2026, 8, 27, 1, 50, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 50, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08632b4f-0a47-4b91-94f7-21c9b814162b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Trying to clone 3ad2e17c-139e-4ac1-b783-58d70e949d1e from image 08632b4f-0a47-4b91-94f7-21c9b814162b at location (None, [{'url': 'file:///opt/stack/data/glance/images/08632b4f-0a47-4b91-94f7-21c9b814162b', 'metadata': {}}]). {{(pid=94328) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 27 03:50:52 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Image download 0.00 MB at 0.00 MB/s Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[f796aa5f-94b1-4a67-a7c6-ee6227fed086]: (4, 'raw') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:52 devstack sudo[109019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD Aug 27 03:50:52 devstack sudo[109019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:52 devstack sudo[109013]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cb97681-8f71-45ce-98b1-064c2e37f343 1073741824" returned: 0 in 0.582s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cb97681-8f71-45ce-98b1-064c2e37f343 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:52 devstack sudo[109021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cb97681-8f71-45ce-98b1-064c2e37f343 Aug 27 03:50:52 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:53 devstack sudo[109019]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD" returned: 0 in 0.648s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:53 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cb97681-8f71-45ce-98b1-064c2e37f343" returned: 0 in 0.674s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:50:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:53 devstack sudo[109042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD Aug 27 03:50:53 devstack sudo[109042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2d4bcf-7d56-431f-8a59-ba40d21311a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cb97681-8f71-45ce-98b1-064c2e37f343', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1c3bbe-6f7a-4b65-b5dd-9e14182e7977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:53 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Volume volume-2cb97681-8f71-45ce-98b1-064c2e37f343 (2cb97681-8f71-45ce-98b1-064c2e37f343): created successfully Aug 27 03:50:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1c3bbe-6f7a-4b65-b5dd-9e14182e7977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Flow 'volume_create_manager' (3a723d0a-af1a-4f6e-bb6f-d2dc355b64d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:50:53 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e680dc47-15ee-4389-aa2e-8eba05a9dad9 tempest-VolumesTransfersV357Test-1766383973 None] Created volume successfully. Aug 27 03:50:54 devstack sudo[109042]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD" returned: 1 in 0.777s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 27 03:50:54 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Temporary image 08632b4f-0a47-4b91-94f7-21c9b814162b is fetched for user ae321af06f2d4b91a7efd38c1ac337f5. {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 27 03:50:54 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97a7ee3-95ad-4aae-9ea7-9725c1da11aa]: (4, 'raw') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:54 devstack sudo[109088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD Aug 27 03:50:54 devstack sudo[109088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:54 devstack sudo[109088]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD" returned: 0 in 0.571s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:54 devstack sudo[109105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD Aug 27 03:50:54 devstack sudo[109105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:55 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-3d7537d2-f00e-42fa-8fcc-b99106e471ad tempest-VolumesTransfersV357Test-401280784 None] Transfer volume completed successfully. Aug 27 03:50:55 devstack sudo[109105]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD" returned: 1 in 0.502s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 27 03:50:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ad2e17c-139e-4ac1-b783-58d70e949d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16b37820a174f78b922922478bedd80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:50:52Z,use_quota=True,user_id='ae321af06f2d4b91a7efd38c1ac337f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ba536e-43e7-4e27-aaa1-ef64243d0ba2),volume_type_id=11ba536e-43e7-4e27-aaa1-ef64243d0ba2)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:50:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Creating volume 3ad2e17c-139e-4ac1-b783-58d70e949d1e {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:50:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:50:55 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:50:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3ad2e17c-139e-4ac1-b783-58d70e949d1e 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:55 devstack sudo[109126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3ad2e17c-139e-4ac1-b783-58d70e949d1e 1073741824 Aug 27 03:50:55 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:56 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2945f7ec-2358-4adc-a4f5-f25a1cafd423 tempest-VolumesTransfersV357Test-1313469056 None] Acquiring lock "cinder-2cb97681-8f71-45ce-98b1-064c2e37f343-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:56 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2945f7ec-2358-4adc-a4f5-f25a1cafd423 tempest-VolumesTransfersV357Test-1313469056 None] Lock "cinder-2cb97681-8f71-45ce-98b1-064c2e37f343-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:56 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3ad2e17c-139e-4ac1-b783-58d70e949d1e 1073741824" returned: 0 in 0.862s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:56 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2945f7ec-2358-4adc-a4f5-f25a1cafd423 tempest-VolumesTransfersV357Test-1313469056 None] Acquiring lock "cinder-quobyte-2cb97681-8f71-45ce-98b1-064c2e37f343" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:56 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2945f7ec-2358-4adc-a4f5-f25a1cafd423 tempest-VolumesTransfersV357Test-1313469056 None] Lock "cinder-quobyte-2cb97681-8f71-45ce-98b1-064c2e37f343" acquired by "delete_volume" :: waited 0.030s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3ad2e17c-139e-4ac1-b783-58d70e949d1e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:56 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e24a05-4337-4394-b9a8-075bba8df574]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2945f7ec-2358-4adc-a4f5-f25a1cafd423 tempest-VolumesTransfersV357Test-1313469056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cb97681-8f71-45ce-98b1-064c2e37f343 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:56 devstack sudo[109134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3ad2e17c-139e-4ac1-b783-58d70e949d1e Aug 27 03:50:56 devstack sudo[109134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:56 devstack sudo[109135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cb97681-8f71-45ce-98b1-064c2e37f343 Aug 27 03:50:56 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:56 devstack sudo[109134]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3ad2e17c-139e-4ac1-b783-58d70e949d1e" returned: 0 in 0.356s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:56 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:50:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:56 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Attempting download of 08632b4f-0a47-4b91-94f7-21c9b814162b ((None, [{'url': 'file:///opt/stack/data/glance/images/08632b4f-0a47-4b91-94f7-21c9b814162b', 'metadata': {}}])) to volume 3ad2e17c-139e-4ac1-b783-58d70e949d1e. {{(pid=94328) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 27 03:50:56 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6900ea-2ecf-4454-a25e-9d665ef87562]: (4, 'raw') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08632b4f-0a47-4b91-94f7-21c9b814162b_mtoavynp {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:56 devstack sudo[109141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08632b4f-0a47-4b91-94f7-21c9b814162b_mtoavynp Aug 27 03:50:56 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:57 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2945f7ec-2358-4adc-a4f5-f25a1cafd423 tempest-VolumesTransfersV357Test-1313469056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cb97681-8f71-45ce-98b1-064c2e37f343" returned: 0 in 0.820s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2945f7ec-2358-4adc-a4f5-f25a1cafd423 tempest-VolumesTransfersV357Test-1313469056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cb97681-8f71-45ce-98b1-064c2e37f343 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:57 devstack sudo[109146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cb97681-8f71-45ce-98b1-064c2e37f343 Aug 27 03:50:57 devstack sudo[109146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:57 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08632b4f-0a47-4b91-94f7-21c9b814162b_mtoavynp" returned: 0 in 0.473s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08632b4f-0a47-4b91-94f7-21c9b814162b_mtoavynp {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:57 devstack sudo[109150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08632b4f-0a47-4b91-94f7-21c9b814162b_mtoavynp Aug 27 03:50:57 devstack sudo[109150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:57 devstack sudo[109146]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2945f7ec-2358-4adc-a4f5-f25a1cafd423 tempest-VolumesTransfersV357Test-1313469056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2cb97681-8f71-45ce-98b1-064c2e37f343" returned: 0 in 0.609s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:57 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2945f7ec-2358-4adc-a4f5-f25a1cafd423 tempest-VolumesTransfersV357Test-1313469056 None] Lock "cinder-quobyte-2cb97681-8f71-45ce-98b1-064c2e37f343" released by "delete_volume" :: held 1.506s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:57 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9a5098e2-9b73-4bfb-beae-a802eb84e536 tempest-VolumesActionsTest-1878717002 None] Acquiring lock "cinder-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3" by "attach_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:57 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9a5098e2-9b73-4bfb-beae-a802eb84e536 tempest-VolumesActionsTest-1878717002 None] Lock "cinder-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3" acquired by "attach_volume" :: waited 0.055s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:57 devstack sudo[109150]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08632b4f-0a47-4b91-94f7-21c9b814162b_mtoavynp" returned: 1 in 0.578s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08632b4f-0a47-4b91-94f7-21c9b814162b_mtoavynp' failed. Not Retrying. {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 27 03:50:57 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d1dfd5-97e1-4684-a80e-6b3967cf6814]: (4, 'raw') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:50:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:57 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-2945f7ec-2358-4adc-a4f5-f25a1cafd423 tempest-VolumesTransfersV357Test-1313469056 None] Created reservations ['52e1ca67-cd58-4711-8ff2-3c311dffa600', '41e847ae-d0f5-4da3-b087-290656160b5a', '0cc45e53-6a32-45aa-b528-929ed5ffc487', '802ad50c-a6ff-48c1-a105-2737c7fe831e'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:50:57 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-9a5098e2-9b73-4bfb-beae-a802eb84e536 tempest-VolumesActionsTest-1878717002 None] Attaching volume c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 to instance e951d55e-2fef-4529-a98a-af0d59e8d6eb at mountpoint /dev/vdb on host None. Aug 27 03:50:57 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-9a5098e2-9b73-4bfb-beae-a802eb84e536 tempest-VolumesActionsTest-1878717002 None] Attach volume completed successfully. Aug 27 03:50:57 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9a5098e2-9b73-4bfb-beae-a802eb84e536 tempest-VolumesActionsTest-1878717002 None] Lock "cinder-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3" released by "attach_volume" :: held 0.199s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:58 devstack sudo[109155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD Aug 27 03:50:58 devstack sudo[109155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2945f7ec-2358-4adc-a4f5-f25a1cafd423 tempest-VolumesTransfersV357Test-1313469056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2945f7ec-2358-4adc-a4f5-f25a1cafd423 tempest-VolumesTransfersV357Test-1313469056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2945f7ec-2358-4adc-a4f5-f25a1cafd423 tempest-VolumesTransfersV357Test-1313469056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2945f7ec-2358-4adc-a4f5-f25a1cafd423 tempest-VolumesTransfersV357Test-1313469056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2945f7ec-2358-4adc-a4f5-f25a1cafd423 tempest-VolumesTransfersV357Test-1313469056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2945f7ec-2358-4adc-a4f5-f25a1cafd423 tempest-VolumesTransfersV357Test-1313469056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:58 devstack sudo[109157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:50:58 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:58 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-67bfad73-39e8-4529-9ef9-3717e3d702da tempest-VolumesActionsTest-1878717002 None] Acquiring lock "cinder-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3-detach_volume" by "detach_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:50:58 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-67bfad73-39e8-4529-9ef9-3717e3d702da tempest-VolumesActionsTest-1878717002 None] Lock "cinder-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3-detach_volume" acquired by "detach_volume" :: waited 0.053s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:50:58 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-67bfad73-39e8-4529-9ef9-3717e3d702da tempest-VolumesActionsTest-1878717002 None] Detaching volume c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 from instance e951d55e-2fef-4529-a98a-af0d59e8d6eb. Aug 27 03:50:58 devstack sudo[109155]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD" returned: 0 in 0.595s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:58 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-67bfad73-39e8-4529-9ef9-3717e3d702da tempest-VolumesActionsTest-1878717002 None] Detach volume completed successfully. Aug 27 03:50:58 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-67bfad73-39e8-4529-9ef9-3717e3d702da tempest-VolumesActionsTest-1878717002 None] Lock "cinder-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3-detach_volume" released by "detach_volume" :: held 0.261s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:58 devstack sudo[109161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD Aug 27 03:50:58 devstack sudo[109161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:58 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2945f7ec-2358-4adc-a4f5-f25a1cafd423 tempest-VolumesTransfersV357Test-1313469056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.707s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:58 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-2945f7ec-2358-4adc-a4f5-f25a1cafd423 tempest-VolumesTransfersV357Test-1313469056 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:50:58 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-2945f7ec-2358-4adc-a4f5-f25a1cafd423 tempest-VolumesTransfersV357Test-1313469056 None] Deleted volume successfully. Aug 27 03:50:58 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2945f7ec-2358-4adc-a4f5-f25a1cafd423 tempest-VolumesTransfersV357Test-1313469056 None] Lock "cinder-2cb97681-8f71-45ce-98b1-064c2e37f343-delete_volume" released by "delete_volume" :: held 2.807s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:50:59 devstack sudo[109161]: pam_unix(sudo:session): session closed for user root Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD" returned: 1 in 0.649s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] 08632b4f-0a47-4b91-94f7-21c9b814162b was raw, converting to qcow2 {{(pid=94328) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3ad2e17c-139e-4ac1-b783-58d70e949d1e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:59 devstack sudo[109167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3ad2e17c-139e-4ac1-b783-58d70e949d1e Aug 27 03:50:59 devstack sudo[109167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Flow 'volume_create_manager' (b1ccc479-4608-4b4d-8b29-9820ca82636f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dd4bb4e-f1d2-4267-bb90-a13edf0cf274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dd4bb4e-f1d2-4267-bb90-a13edf0cf274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1607281193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36ca7fb-695e-400e-99f1-caa9426d36dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16a6fea230e9482fa817e6c3a58d0aec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:51:00Z,use_quota=True,user_id='ab485411f1334519a7b3b633a1b054f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0933cf30-8cf5-42f7-aec3-186d7d02df39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0933cf30-8cf5-42f7-aec3-186d7d02df39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb700f89-b2f2-4826-98ce-0020910001b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb700f89-b2f2-4826-98ce-0020910001b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e36ca7fb-695e-400e-99f1-caa9426d36dc', 'volume_name': 'volume-e36ca7fb-695e-400e-99f1-caa9426d36dc', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3e4e68-ff20-4cd0-aae5-515616945432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3e4e68-ff20-4cd0-aae5-515616945432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15fc905f-8bcc-4f2d-9245-42e80918b7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:50:59 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Volume e36ca7fb-695e-400e-99f1-caa9426d36dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e36ca7fb-695e-400e-99f1-caa9426d36dc', 'volume_size': 1} Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1607281193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36ca7fb-695e-400e-99f1-caa9426d36dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16a6fea230e9482fa817e6c3a58d0aec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:51:00Z,use_quota=True,user_id='ab485411f1334519a7b3b633a1b054f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Creating volume e36ca7fb-695e-400e-99f1-caa9426d36dc {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:50:59 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:50:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e36ca7fb-695e-400e-99f1-caa9426d36dc 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:50:59 devstack sudo[109187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e36ca7fb-695e-400e-99f1-caa9426d36dc 1073741824 Aug 27 03:50:59 devstack sudo[109187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:00 devstack sudo[109167]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3ad2e17c-139e-4ac1-b783-58d70e949d1e" returned: 0 in 0.908s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:00 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_08632b4f-0a47-4b91-94f7-21c9b814162b_bvnzfyjvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3ad2e17c-139e-4ac1-b783-58d70e949d1e {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:51:00 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Converted 0.00 MB image at 0.00 MB/s Aug 27 03:51:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3ad2e17c-139e-4ac1-b783-58d70e949d1e 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:00 devstack sudo[109198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3ad2e17c-139e-4ac1-b783-58d70e949d1e 1G Aug 27 03:51:00 devstack sudo[109198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:00 devstack sudo[109198]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3ad2e17c-139e-4ac1-b783-58d70e949d1e 1G" returned: 0 in 0.458s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:00 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Downloaded image 08632b4f-0a47-4b91-94f7-21c9b814162b ((None, [{'url': 'file:///opt/stack/data/glance/images/08632b4f-0a47-4b91-94f7-21c9b814162b', 'metadata': {}}])) to volume 3ad2e17c-139e-4ac1-b783-58d70e949d1e successfully. {{(pid=94328) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 27 03:51:00 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Temporary image 08632b4f-0a47-4b91-94f7-21c9b814162b for user ae321af06f2d4b91a7efd38c1ac337f5 is deleted. {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 27 03:51:00 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Marking volume 3ad2e17c-139e-4ac1-b783-58d70e949d1e as bootable. {{(pid=94328) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 27 03:51:00 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Copying metadata from image 08632b4f-0a47-4b91-94f7-21c9b814162b to 3ad2e17c-139e-4ac1-b783-58d70e949d1e. {{(pid=94328) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 27 03:51:00 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Creating volume glance metadata for volume 3ad2e17c-139e-4ac1-b783-58d70e949d1e backed by image 08632b4f-0a47-4b91-94f7-21c9b814162b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '08632b4f-0a47-4b91-94f7-21c9b814162b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3f616e9c9a9a0dd9e4dc7771bbd96f1a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94328) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 27 03:51:00 devstack sudo[109187]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e36ca7fb-695e-400e-99f1-caa9426d36dc 1073741824" returned: 0 in 0.764s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e36ca7fb-695e-400e-99f1-caa9426d36dc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:00 devstack sudo[109209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e36ca7fb-695e-400e-99f1-caa9426d36dc Aug 27 03:51:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e6aadc-2671-4e5e-ae91-fa60666b970c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ad2e17c-139e-4ac1-b783-58d70e949d1e', 'volume_size': 1, 'image_id': '08632b4f-0a47-4b91-94f7-21c9b814162b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08632b4f-0a47-4b91-94f7-21c9b814162b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f616e9c9a9a0dd9e4dc7771bbd96f1a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e16b37820a174f78b922922478bedd80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd077ed34a87e2f47ad5a38dd04183e7cbe9529508ceadb2dac1e11526c7995e7a51733b64c11e21c7d229e5cc4660c73f608f76dd22b48a9096247d0b6a6f3e8', 'id': '08632b4f-0a47-4b91-94f7-21c9b814162b', 'created_at': datetime.datetime(2026, 8, 27, 1, 50, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 50, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08632b4f-0a47-4b91-94f7-21c9b814162b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:00 devstack sudo[109209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bdff7b-fd37-4cf5-a0a4-bd6eeb6b9dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:00 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Volume volume-3ad2e17c-139e-4ac1-b783-58d70e949d1e (3ad2e17c-139e-4ac1-b783-58d70e949d1e): created successfully Aug 27 03:51:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bdff7b-fd37-4cf5-a0a4-bd6eeb6b9dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Flow 'volume_create_manager' (4b4ec3f0-ea69-4277-8854-4db19e0abc3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:51:00 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-2acd1ce1-3584-4c50-9d62-a7502a5b5040 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Created volume successfully. Aug 27 03:51:00 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Flow 'volume_create_manager' (6af9b3f9-27ce-4f99-ae12-17f018412883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b379a76-be42-4a95-81ca-e045088fb9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:01 devstack sudo[109209]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b379a76-be42-4a95-81ca-e045088fb9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-87232666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ab4177-5848-4db9-93c0-8a91254e2a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e7a58e41945427eb1e6daf156affa2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:51:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:51:01Z,use_quota=True,user_id='b24803d3f5704a14992595d777061c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3f1578-3084-4035-bc02-0c7c7b359590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3f1578-3084-4035-bc02-0c7c7b359590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c360267-1be6-4bdc-81a0-c2fcae4f87d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c360267-1be6-4bdc-81a0-c2fcae4f87d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70ab4177-5848-4db9-93c0-8a91254e2a99', 'volume_name': 'volume-70ab4177-5848-4db9-93c0-8a91254e2a99', 'volume_size': 2}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75dadbd9-abee-4156-9c3d-000401bd45e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75dadbd9-abee-4156-9c3d-000401bd45e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714dd799-c74e-4d15-8863-3d8fa250f6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:01 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Volume 70ab4177-5848-4db9-93c0-8a91254e2a99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70ab4177-5848-4db9-93c0-8a91254e2a99', 'volume_size': 2} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e36ca7fb-695e-400e-99f1-caa9426d36dc" returned: 0 in 0.385s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-87232666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ab4177-5848-4db9-93c0-8a91254e2a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e7a58e41945427eb1e6daf156affa2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:51:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:51:01Z,use_quota=True,user_id='b24803d3f5704a14992595d777061c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Creating volume 70ab4177-5848-4db9-93c0-8a91254e2a99 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:51:01 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99 2147483648 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15fc905f-8bcc-4f2d-9245-42e80918b7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e36ca7fb-695e-400e-99f1-caa9426d36dc', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e41f5569-12d5-4430-b770-9ee968f1fff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:01 devstack sudo[109213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99 2147483648 Aug 27 03:51:01 devstack sudo[109213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:01 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Volume volume-e36ca7fb-695e-400e-99f1-caa9426d36dc (e36ca7fb-695e-400e-99f1-caa9426d36dc): created successfully Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e41f5569-12d5-4430-b770-9ee968f1fff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Flow 'volume_create_manager' (b1ccc479-4608-4b4d-8b29-9820ca82636f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:51:01 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-8dae1124-d431-4db8-811d-f14e05c76600 tempest-VolumesTransfersV357Test-1766383973 None] Created volume successfully. Aug 27 03:51:01 devstack sudo[109213]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99 2147483648" returned: 0 in 0.581s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:01 devstack sudo[109220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99 Aug 27 03:51:01 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f0b200ca-875d-49d3-8f64-5b8d43055e62 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Acquiring lock "cinder-3ad2e17c-139e-4ac1-b783-58d70e949d1e-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f0b200ca-875d-49d3-8f64-5b8d43055e62 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Lock "cinder-3ad2e17c-139e-4ac1-b783-58d70e949d1e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:51:01 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f0b200ca-875d-49d3-8f64-5b8d43055e62 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Acquiring lock "cinder-quobyte-3ad2e17c-139e-4ac1-b783-58d70e949d1e" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f0b200ca-875d-49d3-8f64-5b8d43055e62 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Lock "cinder-quobyte-3ad2e17c-139e-4ac1-b783-58d70e949d1e" acquired by "delete_volume" :: waited 0.028s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c2f82f-a42a-4a4d-b828-6f57a376ccab]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f0b200ca-875d-49d3-8f64-5b8d43055e62 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3ad2e17c-139e-4ac1-b783-58d70e949d1e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:02 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99" returned: 0 in 0.409s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714dd799-c74e-4d15-8863-3d8fa250f6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70ab4177-5848-4db9-93c0-8a91254e2a99', 'volume_size': 2}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd2504e-b22f-4539-a173-4c08a81bec32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:02 devstack sudo[109222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3ad2e17c-139e-4ac1-b783-58d70e949d1e Aug 27 03:51:02 devstack sudo[109222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:02 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Volume volume-70ab4177-5848-4db9-93c0-8a91254e2a99 (70ab4177-5848-4db9-93c0-8a91254e2a99): created successfully Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd2504e-b22f-4539-a173-4c08a81bec32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Flow 'volume_create_manager' (6af9b3f9-27ce-4f99-ae12-17f018412883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-07ad2d0b-6dba-43b7-8dce-764beaf21a57 tempest-VolumesTransfersV357Test-1313469056 None] Acquiring lock "cinder-e36ca7fb-695e-400e-99f1-caa9426d36dc-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-07ad2d0b-6dba-43b7-8dce-764beaf21a57 tempest-VolumesTransfersV357Test-1313469056 None] Lock "cinder-e36ca7fb-695e-400e-99f1-caa9426d36dc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:51:02 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-a3d25f12-3154-4102-a3cd-f47a68244cfd tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Created volume successfully. Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-07ad2d0b-6dba-43b7-8dce-764beaf21a57 tempest-VolumesTransfersV357Test-1313469056 None] Acquiring lock "cinder-quobyte-e36ca7fb-695e-400e-99f1-caa9426d36dc" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-07ad2d0b-6dba-43b7-8dce-764beaf21a57 tempest-VolumesTransfersV357Test-1313469056 None] Lock "cinder-quobyte-e36ca7fb-695e-400e-99f1-caa9426d36dc" acquired by "delete_volume" :: waited 0.018s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:51:02 devstack sudo[109222]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f0b200ca-875d-49d3-8f64-5b8d43055e62 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3ad2e17c-139e-4ac1-b783-58d70e949d1e" returned: 0 in 0.446s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f0b200ca-875d-49d3-8f64-5b8d43055e62 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3ad2e17c-139e-4ac1-b783-58d70e949d1e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8305da-baab-4e59-a1b8-a187db62d314]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-07ad2d0b-6dba-43b7-8dce-764beaf21a57 tempest-VolumesTransfersV357Test-1313469056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e36ca7fb-695e-400e-99f1-caa9426d36dc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:02 devstack sudo[109228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3ad2e17c-139e-4ac1-b783-58d70e949d1e Aug 27 03:51:02 devstack sudo[109228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:02 devstack sudo[109229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e36ca7fb-695e-400e-99f1-caa9426d36dc Aug 27 03:51:02 devstack sudo[109229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:02 devstack sudo[109228]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f0b200ca-875d-49d3-8f64-5b8d43055e62 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3ad2e17c-139e-4ac1-b783-58d70e949d1e" returned: 0 in 0.262s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f0b200ca-875d-49d3-8f64-5b8d43055e62 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Lock "cinder-quobyte-3ad2e17c-139e-4ac1-b783-58d70e949d1e" released by "delete_volume" :: held 0.769s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:51:02 devstack cinder-volume[94328]: WARNING cinder.quota [None req-f0b200ca-875d-49d3-8f64-5b8d43055e62 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:51:02 devstack cinder-volume[94328]: WARNING cinder.quota [None req-f0b200ca-875d-49d3-8f64-5b8d43055e62 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-f0b200ca-875d-49d3-8f64-5b8d43055e62 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Created reservations ['11753c9f-8df6-4982-8302-19290a077e67', '8ab625b2-ead3-4614-8994-de8bc62548b5', '60af0625-9aef-4d24-b498-5b1b7319e6ae', '4706a3b7-7edd-4420-951b-1511fccb0fbe'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f0b200ca-875d-49d3-8f64-5b8d43055e62 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f0b200ca-875d-49d3-8f64-5b8d43055e62 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f0b200ca-875d-49d3-8f64-5b8d43055e62 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f0b200ca-875d-49d3-8f64-5b8d43055e62 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f0b200ca-875d-49d3-8f64-5b8d43055e62 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f0b200ca-875d-49d3-8f64-5b8d43055e62 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:02 devstack sudo[109237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:51:02 devstack sudo[109237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:03 devstack sudo[109229]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-07ad2d0b-6dba-43b7-8dce-764beaf21a57 tempest-VolumesTransfersV357Test-1313469056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e36ca7fb-695e-400e-99f1-caa9426d36dc" returned: 0 in 0.524s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-07ad2d0b-6dba-43b7-8dce-764beaf21a57 tempest-VolumesTransfersV357Test-1313469056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e36ca7fb-695e-400e-99f1-caa9426d36dc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:03 devstack sudo[109239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e36ca7fb-695e-400e-99f1-caa9426d36dc Aug 27 03:51:03 devstack sudo[109239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b8588929-8ccd-4d88-8325-f3ec4191df3e tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b8588929-8ccd-4d88-8325-f3ec4191df3e tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:03 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-b8588929-8ccd-4d88-8325-f3ec4191df3e tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Creating offline snapshot b48d0cea-4319-4841-beff-935029392e10 of volume 70ab4177-5848-4db9-93c0-8a91254e2a99 {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:51:03 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[47888a1b-f38f-4dbb-9688-f199f21c5bdd]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:51:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b8588929-8ccd-4d88-8325-f3ec4191df3e tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:03 devstack sudo[109237]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f0b200ca-875d-49d3-8f64-5b8d43055e62 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.503s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:03 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-f0b200ca-875d-49d3-8f64-5b8d43055e62 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:51:03 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f0b200ca-875d-49d3-8f64-5b8d43055e62 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Deleted volume successfully. Aug 27 03:51:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f0b200ca-875d-49d3-8f64-5b8d43055e62 tempest-VolumeAndVolumeTypeFromImageTest-2145391034 None] Lock "cinder-3ad2e17c-139e-4ac1-b783-58d70e949d1e-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:51:03 devstack sudo[109239]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:03 devstack sudo[109244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99 Aug 27 03:51:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-07ad2d0b-6dba-43b7-8dce-764beaf21a57 tempest-VolumesTransfersV357Test-1313469056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e36ca7fb-695e-400e-99f1-caa9426d36dc" returned: 0 in 0.511s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:03 devstack sudo[109244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-07ad2d0b-6dba-43b7-8dce-764beaf21a57 tempest-VolumesTransfersV357Test-1313469056 None] Lock "cinder-quobyte-e36ca7fb-695e-400e-99f1-caa9426d36dc" released by "delete_volume" :: held 1.103s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:51:03 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-07ad2d0b-6dba-43b7-8dce-764beaf21a57 tempest-VolumesTransfersV357Test-1313469056 None] Created reservations ['aaf321d7-8246-4407-8f46-9b26f82d95b0', 'd960a7fe-490e-41fa-b57d-9225ffd438d3', 'de2d0cdd-324e-467b-b982-de268efb3b4e', 'c811a3a4-cbfe-4866-9460-1b1f1d81658c'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:51:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-07ad2d0b-6dba-43b7-8dce-764beaf21a57 tempest-VolumesTransfersV357Test-1313469056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-07ad2d0b-6dba-43b7-8dce-764beaf21a57 tempest-VolumesTransfersV357Test-1313469056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:03 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-07ad2d0b-6dba-43b7-8dce-764beaf21a57 tempest-VolumesTransfersV357Test-1313469056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:51:03 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-07ad2d0b-6dba-43b7-8dce-764beaf21a57 tempest-VolumesTransfersV357Test-1313469056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:51:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-07ad2d0b-6dba-43b7-8dce-764beaf21a57 tempest-VolumesTransfersV357Test-1313469056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-07ad2d0b-6dba-43b7-8dce-764beaf21a57 tempest-VolumesTransfersV357Test-1313469056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:03 devstack sudo[109250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:51:03 devstack sudo[109250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:03 devstack sudo[109244]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b8588929-8ccd-4d88-8325-f3ec4191df3e tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99" returned: 0 in 0.557s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b8588929-8ccd-4d88-8325-f3ec4191df3e tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.b48d0cea-4319-4841-beff-935029392e10 2G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:03 devstack sudo[109256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.b48d0cea-4319-4841-beff-935029392e10 2G Aug 27 03:51:03 devstack sudo[109256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:04 devstack sudo[109250]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-07ad2d0b-6dba-43b7-8dce-764beaf21a57 tempest-VolumesTransfersV357Test-1313469056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.301s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:04 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-07ad2d0b-6dba-43b7-8dce-764beaf21a57 tempest-VolumesTransfersV357Test-1313469056 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:51:04 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-07ad2d0b-6dba-43b7-8dce-764beaf21a57 tempest-VolumesTransfersV357Test-1313469056 None] Deleted volume successfully. Aug 27 03:51:04 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-07ad2d0b-6dba-43b7-8dce-764beaf21a57 tempest-VolumesTransfersV357Test-1313469056 None] Lock "cinder-e36ca7fb-695e-400e-99f1-caa9426d36dc-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:51:04 devstack sudo[109256]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b8588929-8ccd-4d88-8325-f3ec4191df3e tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.b48d0cea-4319-4841-beff-935029392e10 2G" returned: 0 in 0.574s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b8588929-8ccd-4d88-8325-f3ec4191df3e tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ab4177-5848-4db9-93c0-8a91254e2a99 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.b48d0cea-4319-4841-beff-935029392e10 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:04 devstack sudo[109263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ab4177-5848-4db9-93c0-8a91254e2a99 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.b48d0cea-4319-4841-beff-935029392e10 Aug 27 03:51:04 devstack sudo[109263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:04 devstack sudo[109263]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b8588929-8ccd-4d88-8325-f3ec4191df3e tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ab4177-5848-4db9-93c0-8a91254e2a99 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.b48d0cea-4319-4841-beff-935029392e10" returned: 0 in 0.366s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:04 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-b8588929-8ccd-4d88-8325-f3ec4191df3e tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.b48d0cea-4319-4841-beff-935029392e10 is being set with open permissions: ugo+rw Aug 27 03:51:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b8588929-8ccd-4d88-8325-f3ec4191df3e tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.b48d0cea-4319-4841-beff-935029392e10 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:04 devstack sudo[109269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.b48d0cea-4319-4841-beff-935029392e10 Aug 27 03:51:04 devstack sudo[109269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:05 devstack sudo[109269]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b8588929-8ccd-4d88-8325-f3ec4191df3e tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.b48d0cea-4319-4841-beff-935029392e10" returned: 0 in 0.338s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b8588929-8ccd-4d88-8325-f3ec4191df3e tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:05 devstack sudo[109272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.info Aug 27 03:51:05 devstack sudo[109272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:05 devstack sudo[109272]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b8588929-8ccd-4d88-8325-f3ec4191df3e tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.info" returned: 0 in 0.498s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:05 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-b8588929-8ccd-4d88-8325-f3ec4191df3e tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.info is being set with open permissions: ugo+rw Aug 27 03:51:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b8588929-8ccd-4d88-8325-f3ec4191df3e tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:05 devstack sudo[109279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.info Aug 27 03:51:05 devstack sudo[109279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:06 devstack sudo[109279]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b8588929-8ccd-4d88-8325-f3ec4191df3e tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.info" returned: 0 in 0.342s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b8588929-8ccd-4d88-8325-f3ec4191df3e tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.839s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:06 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-b8588929-8ccd-4d88-8325-f3ec4191df3e tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Create snapshot completed successfully Aug 27 03:51:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5bfda979-d0f5-41b1-8722-a014250aa955 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Acquiring lock "cinder-b48d0cea-4319-4841-beff-935029392e10-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:51:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5bfda979-d0f5-41b1-8722-a014250aa955 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Lock "cinder-b48d0cea-4319-4841-beff-935029392e10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:51:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5bfda979-d0f5-41b1-8722-a014250aa955 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Acquiring lock "cinder-quobyte-70ab4177-5848-4db9-93c0-8a91254e2a99" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:51:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5bfda979-d0f5-41b1-8722-a014250aa955 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Lock "cinder-quobyte-70ab4177-5848-4db9-93c0-8a91254e2a99" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:51:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5bfda979-d0f5-41b1-8722-a014250aa955 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Acquiring lock "cinder-quobyte-b48d0cea-4319-4841-beff-935029392e10" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:51:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5bfda979-d0f5-41b1-8722-a014250aa955 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Lock "cinder-quobyte-b48d0cea-4319-4841-beff-935029392e10" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:51:06 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-5bfda979-d0f5-41b1-8722-a014250aa955 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Deleting offline snapshot b48d0cea-4319-4841-beff-935029392e10 of volume 70ab4177-5848-4db9-93c0-8a91254e2a99 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:51:06 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-5bfda979-d0f5-41b1-8722-a014250aa955 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] snapshot_file for this snap is: volume-70ab4177-5848-4db9-93c0-8a91254e2a99.b48d0cea-4319-4841-beff-935029392e10 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:51:06 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[18515861-21f0-4e49-a316-6b1e9894627a]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:51:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5bfda979-d0f5-41b1-8722-a014250aa955 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.b48d0cea-4319-4841-beff-935029392e10 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:06 devstack sudo[109294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.b48d0cea-4319-4841-beff-935029392e10 Aug 27 03:51:06 devstack sudo[109294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:07 devstack sudo[109294]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5bfda979-d0f5-41b1-8722-a014250aa955 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.b48d0cea-4319-4841-beff-935029392e10" returned: 0 in 0.435s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-5bfda979-d0f5-41b1-8722-a014250aa955 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70ab4177-5848-4db9-93c0-8a91254e2a99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:51:07 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[4495382f-ebb3-46bb-97db-6e5cc5fe0d77]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:51:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5bfda979-d0f5-41b1-8722-a014250aa955 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:07 devstack sudo[109299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99 Aug 27 03:51:07 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:07 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5bfda979-d0f5-41b1-8722-a014250aa955 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99" returned: 0 in 0.405s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5bfda979-d0f5-41b1-8722-a014250aa955 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.b48d0cea-4319-4841-beff-935029392e10 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:07 devstack sudo[109304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.b48d0cea-4319-4841-beff-935029392e10 Aug 27 03:51:07 devstack sudo[109304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:08 devstack sudo[109304]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5bfda979-d0f5-41b1-8722-a014250aa955 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.b48d0cea-4319-4841-beff-935029392e10" returned: 0 in 0.504s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5bfda979-d0f5-41b1-8722-a014250aa955 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.b48d0cea-4319-4841-beff-935029392e10 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:08 devstack sudo[109310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.b48d0cea-4319-4841-beff-935029392e10 Aug 27 03:51:08 devstack sudo[109310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:08 devstack sudo[109310]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5bfda979-d0f5-41b1-8722-a014250aa955 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99.b48d0cea-4319-4841-beff-935029392e10" returned: 0 in 0.348s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5bfda979-d0f5-41b1-8722-a014250aa955 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Lock "cinder-quobyte-b48d0cea-4319-4841-beff-935029392e10" released by "_delete_snapshot" :: held 1.837s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:51:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5bfda979-d0f5-41b1-8722-a014250aa955 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Lock "cinder-quobyte-70ab4177-5848-4db9-93c0-8a91254e2a99" released by "delete_snapshot" :: held 1.878s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:51:08 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-5bfda979-d0f5-41b1-8722-a014250aa955 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Created reservations ['798e7a2f-190c-4fd4-a6b4-3a3bac399a4e', '90fd5067-c739-4050-a945-92674acbd113', 'ef57226f-2ed6-4dc6-91dc-7bdeead06266', '55cdc03c-77e9-47ea-a78f-3b20ecdfd56b'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:51:08 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-5bfda979-d0f5-41b1-8722-a014250aa955 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Delete snapshot completed successfully. Aug 27 03:51:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5bfda979-d0f5-41b1-8722-a014250aa955 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Lock "cinder-b48d0cea-4319-4841-beff-935029392e10-delete_snapshot" released by "delete_snapshot" :: held 2.205s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:51:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1ab0d1da-22d1-4e33-8b7f-9943b23ed4c6 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Acquiring lock "cinder-70ab4177-5848-4db9-93c0-8a91254e2a99-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:51:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1ab0d1da-22d1-4e33-8b7f-9943b23ed4c6 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Lock "cinder-70ab4177-5848-4db9-93c0-8a91254e2a99-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:51:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1ab0d1da-22d1-4e33-8b7f-9943b23ed4c6 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Acquiring lock "cinder-quobyte-70ab4177-5848-4db9-93c0-8a91254e2a99" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:51:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1ab0d1da-22d1-4e33-8b7f-9943b23ed4c6 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Lock "cinder-quobyte-70ab4177-5848-4db9-93c0-8a91254e2a99" acquired by "delete_volume" :: waited 0.046s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:51:09 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fff143b-5cd4-4ae0-b3f2-5c8f17575196]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:51:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1ab0d1da-22d1-4e33-8b7f-9943b23ed4c6 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:09 devstack sudo[109346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99 Aug 27 03:51:09 devstack sudo[109346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:10 devstack sudo[109346]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1ab0d1da-22d1-4e33-8b7f-9943b23ed4c6 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99" returned: 0 in 0.682s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1ab0d1da-22d1-4e33-8b7f-9943b23ed4c6 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:10 devstack sudo[109378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99 Aug 27 03:51:10 devstack sudo[109378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:10 devstack sudo[109378]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1ab0d1da-22d1-4e33-8b7f-9943b23ed4c6 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-70ab4177-5848-4db9-93c0-8a91254e2a99" returned: 0 in 0.452s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1ab0d1da-22d1-4e33-8b7f-9943b23ed4c6 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Lock "cinder-quobyte-70ab4177-5848-4db9-93c0-8a91254e2a99" released by "delete_volume" :: held 1.224s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:51:10 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-1ab0d1da-22d1-4e33-8b7f-9943b23ed4c6 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Created reservations ['2e04da3f-773d-4247-b81d-2c34e74a3241', '0efaa045-8fb2-489f-ba2d-f95995cc50e1', '4713464c-c2e9-4744-9749-4664b5d7d625', '11e9c530-631d-4fc6-ac23-da810fad0c44'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:51:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1ab0d1da-22d1-4e33-8b7f-9943b23ed4c6 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1ab0d1da-22d1-4e33-8b7f-9943b23ed4c6 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1ab0d1da-22d1-4e33-8b7f-9943b23ed4c6 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:51:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1ab0d1da-22d1-4e33-8b7f-9943b23ed4c6 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:51:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1ab0d1da-22d1-4e33-8b7f-9943b23ed4c6 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1ab0d1da-22d1-4e33-8b7f-9943b23ed4c6 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:10 devstack sudo[109404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:51:10 devstack sudo[109404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:11 devstack sudo[109404]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1ab0d1da-22d1-4e33-8b7f-9943b23ed4c6 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.296s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-1ab0d1da-22d1-4e33-8b7f-9943b23ed4c6 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:51:11 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-1ab0d1da-22d1-4e33-8b7f-9943b23ed4c6 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Deleted volume successfully. Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1ab0d1da-22d1-4e33-8b7f-9943b23ed4c6 tempest-VolumesSnapshotNegativeTestJSON-1588617639 None] Lock "cinder-70ab4177-5848-4db9-93c0-8a91254e2a99-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Flow 'volume_create_manager' (70bb7ac5-6652-4b64-b183-0c828f65b1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903cfdbd-8cb6-4f2c-a24e-42d8ecafb87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903cfdbd-8cb6-4f2c-a24e-42d8ecafb87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2080211556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b9439e-eaae-4e34-afbe-5ad7cdcbe120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca222e7172e47c489f5bf57dfec1af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:51:12Z,use_quota=True,user_id='831203796fb64a26bb2ac65e32350835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d34eba-db28-487c-96e3-bbe54c47ba05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d34eba-db28-487c-96e3-bbe54c47ba05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ad35fd-4f7a-40ae-a629-6dbbec066bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ad35fd-4f7a-40ae-a629-6dbbec066bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17b9439e-eaae-4e34-afbe-5ad7cdcbe120', 'volume_name': 'volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4280f63-9b32-4cab-bad0-14f2bf069823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4280f63-9b32-4cab-bad0-14f2bf069823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2263c2f-e288-4ef0-bad9-0e1ef861624c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:11 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Volume 17b9439e-eaae-4e34-afbe-5ad7cdcbe120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120', 'volume_size': 1} Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2080211556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b9439e-eaae-4e34-afbe-5ad7cdcbe120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca222e7172e47c489f5bf57dfec1af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:51:12Z,use_quota=True,user_id='831203796fb64a26bb2ac65e32350835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Creating volume 17b9439e-eaae-4e34-afbe-5ad7cdcbe120 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:51:11 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:51:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:11 devstack sudo[109409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120 1073741824 Aug 27 03:51:11 devstack sudo[109409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:12 devstack sudo[109409]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120 1073741824" returned: 0 in 0.691s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:12 devstack sudo[109449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120 Aug 27 03:51:12 devstack sudo[109449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:13 devstack sudo[109449]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120" returned: 0 in 0.373s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:13 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:51:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2263c2f-e288-4ef0-bad9-0e1ef861624c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6151ba5-4366-4f4a-8559-28d301c4236c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:13 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Volume volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120 (17b9439e-eaae-4e34-afbe-5ad7cdcbe120): created successfully Aug 27 03:51:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6151ba5-4366-4f4a-8559-28d301c4236c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Flow 'volume_create_manager' (70bb7ac5-6652-4b64-b183-0c828f65b1e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:51:13 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d8ca711c-9800-4d6c-bcf1-559204ec2f2d tempest-CreateVolumesFromSnapshotTest-1438265473 None] Created volume successfully. Aug 27 03:51:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6ff642f9-2bbc-44f6-945a-6f5e0388ebb8 tempest-VolumesActionsTest-1878717002 None] Acquiring lock "cinder-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3" by "attach_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:51:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6ff642f9-2bbc-44f6-945a-6f5e0388ebb8 tempest-VolumesActionsTest-1878717002 None] Lock "cinder-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3" acquired by "attach_volume" :: waited 0.028s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:51:13 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-6ff642f9-2bbc-44f6-945a-6f5e0388ebb8 tempest-VolumesActionsTest-1878717002 None] Attaching volume c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 to instance e4c9b77f-2210-48a4-a261-c8b736e77b68 at mountpoint /dev/vdb on host None. Aug 27 03:51:13 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-6ff642f9-2bbc-44f6-945a-6f5e0388ebb8 tempest-VolumesActionsTest-1878717002 None] Attach volume completed successfully. Aug 27 03:51:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6ff642f9-2bbc-44f6-945a-6f5e0388ebb8 tempest-VolumesActionsTest-1878717002 None] Lock "cinder-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3" released by "attach_volume" :: held 0.145s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:51:14 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ecbed513-d70e-470b-bacb-2a73fd437e4d tempest-VolumesActionsTest-1878717002 None] Acquiring lock "cinder-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3-detach_volume" by "detach_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:51:14 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ecbed513-d70e-470b-bacb-2a73fd437e4d tempest-VolumesActionsTest-1878717002 None] Lock "cinder-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3-detach_volume" acquired by "detach_volume" :: waited 0.050s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:51:14 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-ecbed513-d70e-470b-bacb-2a73fd437e4d tempest-VolumesActionsTest-1878717002 None] Detaching volume c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 from instance e4c9b77f-2210-48a4-a261-c8b736e77b68. Aug 27 03:51:14 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-ecbed513-d70e-470b-bacb-2a73fd437e4d tempest-VolumesActionsTest-1878717002 None] Detach volume completed successfully. Aug 27 03:51:14 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ecbed513-d70e-470b-bacb-2a73fd437e4d tempest-VolumesActionsTest-1878717002 None] Lock "cinder-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3-detach_volume" released by "detach_volume" :: held 0.180s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:51:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b1807ea5-677c-4166-a257-0b18d63a55b8 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b1807ea5-677c-4166-a257-0b18d63a55b8 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-b1807ea5-677c-4166-a257-0b18d63a55b8 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Creating offline snapshot 00f486a9-cbec-49a8-9450-a4dfed6cb9cc of volume 17b9439e-eaae-4e34-afbe-5ad7cdcbe120 {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:51:14 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a20ecc-4aa0-422d-91e4-d251db8eca35]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:51:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b1807ea5-677c-4166-a257-0b18d63a55b8 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:14 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:51:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:51:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:51:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:15 devstack sudo[109458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:51:15 devstack sudo[109458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:15 devstack sudo[109456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120 Aug 27 03:51:15 devstack sudo[109456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:15 devstack sudo[109456]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b1807ea5-677c-4166-a257-0b18d63a55b8 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120" returned: 0 in 0.788s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:15 devstack sudo[109458]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b1807ea5-677c-4166-a257-0b18d63a55b8 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.00f486a9-cbec-49a8-9450-a4dfed6cb9cc 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.677s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:51:15 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager._thread_info {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:51:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread count: 28 {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 03:51:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread info: [<_MainThread(MainThread, started 134250325188736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 03:51:15 devstack sudo[109476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.00f486a9-cbec-49a8-9450-a4dfed6cb9cc 1G Aug 27 03:51:15 devstack sudo[109476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:16 devstack sudo[109476]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b1807ea5-677c-4166-a257-0b18d63a55b8 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.00f486a9-cbec-49a8-9450-a4dfed6cb9cc 1G" returned: 0 in 0.719s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b1807ea5-677c-4166-a257-0b18d63a55b8 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.00f486a9-cbec-49a8-9450-a4dfed6cb9cc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:16 devstack sudo[109501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.00f486a9-cbec-49a8-9450-a4dfed6cb9cc Aug 27 03:51:16 devstack sudo[109501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:16 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:51:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Flow 'volume_create_manager' (1910a8c7-5c12-4814-9783-3e53ace1ca29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:51:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3f921b-b281-4389-b900-a2fa2f3ad77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3f921b-b281-4389-b900-a2fa2f3ad77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-236859495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45bee4e1-332c-4576-95b2-a153c5f45eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1225fbb26ccb45a9b63850b0d6105421',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:51:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:51:16Z,use_quota=True,user_id='fa5f151a8fdb4bda9f621eb6e7d4b7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a64d678-cde0-4b50-bda7-9294f62493b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a64d678-cde0-4b50-bda7-9294f62493b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0046f247-6f09-4b6c-8121-03dd6d376751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0046f247-6f09-4b6c-8121-03dd6d376751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45bee4e1-332c-4576-95b2-a153c5f45eb2', 'volume_name': 'volume-45bee4e1-332c-4576-95b2-a153c5f45eb2', 'volume_size': 2}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a0d586-287a-4c06-8b20-c9218476bb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a0d586-287a-4c06-8b20-c9218476bb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcbba56d-f62c-4597-98a4-de0f6899c20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:16 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Volume 45bee4e1-332c-4576-95b2-a153c5f45eb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45bee4e1-332c-4576-95b2-a153c5f45eb2', 'volume_size': 2} Aug 27 03:51:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:16 devstack sudo[109501]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b1807ea5-677c-4166-a257-0b18d63a55b8 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.00f486a9-cbec-49a8-9450-a4dfed6cb9cc" returned: 0 in 0.488s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:16 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-b1807ea5-677c-4166-a257-0b18d63a55b8 tempest-CreateVolumesFromSnapshotTest-1438265473 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.00f486a9-cbec-49a8-9450-a4dfed6cb9cc is being set with open permissions: ugo+rw Aug 27 03:51:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b1807ea5-677c-4166-a257-0b18d63a55b8 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.00f486a9-cbec-49a8-9450-a4dfed6cb9cc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:16 devstack sudo[109506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.00f486a9-cbec-49a8-9450-a4dfed6cb9cc Aug 27 03:51:16 devstack sudo[109506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:17 devstack sudo[109506]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b1807ea5-677c-4166-a257-0b18d63a55b8 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.00f486a9-cbec-49a8-9450-a4dfed6cb9cc" returned: 0 in 0.364s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b1807ea5-677c-4166-a257-0b18d63a55b8 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:17 devstack sudo[109511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.info Aug 27 03:51:17 devstack sudo[109511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:17 devstack sudo[109511]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b1807ea5-677c-4166-a257-0b18d63a55b8 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.info" returned: 0 in 0.304s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:17 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-b1807ea5-677c-4166-a257-0b18d63a55b8 tempest-CreateVolumesFromSnapshotTest-1438265473 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.info is being set with open permissions: ugo+rw Aug 27 03:51:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b1807ea5-677c-4166-a257-0b18d63a55b8 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:17 devstack sudo[109514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.info Aug 27 03:51:17 devstack sudo[109514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:17 devstack sudo[109514]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b1807ea5-677c-4166-a257-0b18d63a55b8 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.info" returned: 0 in 0.311s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b1807ea5-677c-4166-a257-0b18d63a55b8 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.233s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.396s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:17 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-236859495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45bee4e1-332c-4576-95b2-a153c5f45eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1225fbb26ccb45a9b63850b0d6105421',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:51:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:51:16Z,use_quota=True,user_id='fa5f151a8fdb4bda9f621eb6e7d4b7d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:51:17 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Creating volume 45bee4e1-332c-4576-95b2-a153c5f45eb2 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:51:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:17 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:51:17 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:51:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:17 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:51:17 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:51:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45bee4e1-332c-4576-95b2-a153c5f45eb2 2147483648 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:17 devstack sudo[109517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45bee4e1-332c-4576-95b2-a153c5f45eb2 2147483648 Aug 27 03:51:17 devstack sudo[109517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:17 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-b1807ea5-677c-4166-a257-0b18d63a55b8 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Create snapshot completed successfully Aug 27 03:51:18 devstack sudo[109517]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45bee4e1-332c-4576-95b2-a153c5f45eb2 2147483648" returned: 0 in 0.605s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45bee4e1-332c-4576-95b2-a153c5f45eb2 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:18 devstack sudo[109523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45bee4e1-332c-4576-95b2-a153c5f45eb2 Aug 27 03:51:18 devstack sudo[109523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:18 devstack sudo[109523]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45bee4e1-332c-4576-95b2-a153c5f45eb2" returned: 0 in 0.366s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:51:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcbba56d-f62c-4597-98a4-de0f6899c20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45bee4e1-332c-4576-95b2-a153c5f45eb2', 'volume_size': 2}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc556d8-3c5b-40bb-ba6d-0590946a735d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:18 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Volume volume-45bee4e1-332c-4576-95b2-a153c5f45eb2 (45bee4e1-332c-4576-95b2-a153c5f45eb2): created successfully Aug 27 03:51:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc556d8-3c5b-40bb-ba6d-0590946a735d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Flow 'volume_create_manager' (1910a8c7-5c12-4814-9783-3e53ace1ca29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:51:19 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-75b6ef23-93b6-4a21-9ac5-178374d076d3 tempest-VolumesCloneNegativeTest-102730401 None] Created volume successfully. Aug 27 03:51:19 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:51:19 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Flow 'volume_create_manager' (8c2598ba-6a9d-4651-845f-c8fb486bce97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:51:19 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00dd577-ea54-4d72-bc29-08e772647d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:19 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00dd577-ea54-4d72-bc29-08e772647d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-225791761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=431ff464-bd22-4f48-9062-6adfd5193807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca222e7172e47c489f5bf57dfec1af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:51:19Z,use_quota=True,user_id='831203796fb64a26bb2ac65e32350835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:19 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e076d0-4616-4ee2-8bc8-d67cc22c2fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:19 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e076d0-4616-4ee2-8bc8-d67cc22c2fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:19 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (059d268a-5b65-4d87-b084-1f57ae192597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:19 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (059d268a-5b65-4d87-b084-1f57ae192597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '431ff464-bd22-4f48-9062-6adfd5193807', 'volume_name': 'volume-431ff464-bd22-4f48-9062-6adfd5193807', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:19 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a25afb-cb15-4f65-9b38-58a9daf50cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:19 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a25afb-cb15-4f65-9b38-58a9daf50cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:19 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0530b1b3-5447-44ad-9e98-df6453749fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:19 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Volume 431ff464-bd22-4f48-9062-6adfd5193807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-431ff464-bd22-4f48-9062-6adfd5193807', 'volume_size': 1} Aug 27 03:51:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-225791761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=431ff464-bd22-4f48-9062-6adfd5193807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca222e7172e47c489f5bf57dfec1af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:51:19Z,use_quota=True,user_id='831203796fb64a26bb2ac65e32350835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:51:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Creating volume 431ff464-bd22-4f48-9062-6adfd5193807 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:51:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:51:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:51:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:51:19 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:51:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-431ff464-bd22-4f48-9062-6adfd5193807 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:19 devstack sudo[109526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-431ff464-bd22-4f48-9062-6adfd5193807 1073741824 Aug 27 03:51:19 devstack sudo[109526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Flow 'volume_create_manager' (e48312df-b0cf-4500-a021-68999dff84ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be02d29-9645-490d-9eab-45e0b525def1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be02d29-9645-490d-9eab-45e0b525def1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1853493141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db0020b-473f-420a-b8cf-a17126171936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca222e7172e47c489f5bf57dfec1af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:51:20Z,use_quota=True,user_id='831203796fb64a26bb2ac65e32350835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45aabd3-fe3f-4ec3-bdac-d3dd3d35d621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45aabd3-fe3f-4ec3-bdac-d3dd3d35d621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053814a6-5b52-4523-bae0-d5ef000b1b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053814a6-5b52-4523-bae0-d5ef000b1b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7db0020b-473f-420a-b8cf-a17126171936', 'volume_name': 'volume-7db0020b-473f-420a-b8cf-a17126171936', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62df2737-39fb-4259-9291-d7c789462af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62df2737-39fb-4259-9291-d7c789462af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba90c1bf-90e3-4958-8c41-ebfb76a00dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:20 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Volume 7db0020b-473f-420a-b8cf-a17126171936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7db0020b-473f-420a-b8cf-a17126171936', 'volume_size': 1} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:20 devstack sudo[109526]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-431ff464-bd22-4f48-9062-6adfd5193807 1073741824" returned: 0 in 0.706s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-431ff464-bd22-4f48-9062-6adfd5193807 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:20 devstack sudo[109531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-431ff464-bd22-4f48-9062-6adfd5193807 Aug 27 03:51:20 devstack sudo[109531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Flow 'volume_create_manager' (41b7ee31-3e8b-43bc-850d-df022c2be430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72da89d-59db-4c93-b686-265f91e7b204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72da89d-59db-4c93-b686-265f91e7b204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-657153116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc65109-a0aa-4ccf-bb4b-485698af38b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca222e7172e47c489f5bf57dfec1af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:51:21Z,use_quota=True,user_id='831203796fb64a26bb2ac65e32350835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e65b622a-08e0-439d-992a-2e5d820fcfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e65b622a-08e0-439d-992a-2e5d820fcfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58954d1a-25b3-4aa5-bf81-a6acc92555ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58954d1a-25b3-4aa5-bf81-a6acc92555ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dc65109-a0aa-4ccf-bb4b-485698af38b0', 'volume_name': 'volume-9dc65109-a0aa-4ccf-bb4b-485698af38b0', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57bdf242-bc05-4f37-b747-262a5182bc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57bdf242-bc05-4f37-b747-262a5182bc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (307742d4-8a6e-463d-b8ad-af9b6bfcbcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:20 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Volume 9dc65109-a0aa-4ccf-bb4b-485698af38b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dc65109-a0aa-4ccf-bb4b-485698af38b0', 'volume_size': 1} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d7d6bff6-fd18-426a-832a-0c209509130d tempest-VolumesActionsTest-1878717002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:20 devstack sudo[109531]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-431ff464-bd22-4f48-9062-6adfd5193807" returned: 0 in 0.383s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.527s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1853493141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db0020b-473f-420a-b8cf-a17126171936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca222e7172e47c489f5bf57dfec1af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:51:20Z,use_quota=True,user_id='831203796fb64a26bb2ac65e32350835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Creating volume 7db0020b-473f-420a-b8cf-a17126171936 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:51:20 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7db0020b-473f-420a-b8cf-a17126171936 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0530b1b3-5447-44ad-9e98-df6453749fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-431ff464-bd22-4f48-9062-6adfd5193807', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (611409a6-0b59-49fe-bc2c-b18b4838f165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:20 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Volume volume-431ff464-bd22-4f48-9062-6adfd5193807 (431ff464-bd22-4f48-9062-6adfd5193807): created successfully Aug 27 03:51:20 devstack sudo[109534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7db0020b-473f-420a-b8cf-a17126171936 1073741824 Aug 27 03:51:20 devstack sudo[109534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (611409a6-0b59-49fe-bc2c-b18b4838f165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Flow 'volume_create_manager' (8c2598ba-6a9d-4651-845f-c8fb486bce97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:51:20 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-285ae262-941f-40ba-ad53-2b2051d4fd40 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Created volume successfully. Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-daa85784-fb68-435d-adde-94f8c3c074a2 tempest-VolumesCloneNegativeTest-102730401 None] Acquiring lock "cinder-45bee4e1-332c-4576-95b2-a153c5f45eb2-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-daa85784-fb68-435d-adde-94f8c3c074a2 tempest-VolumesCloneNegativeTest-102730401 None] Lock "cinder-45bee4e1-332c-4576-95b2-a153c5f45eb2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-daa85784-fb68-435d-adde-94f8c3c074a2 tempest-VolumesCloneNegativeTest-102730401 None] Acquiring lock "cinder-quobyte-45bee4e1-332c-4576-95b2-a153c5f45eb2" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-daa85784-fb68-435d-adde-94f8c3c074a2 tempest-VolumesCloneNegativeTest-102730401 None] Lock "cinder-quobyte-45bee4e1-332c-4576-95b2-a153c5f45eb2" acquired by "delete_volume" :: waited 0.021s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[30320fbc-567d-46f9-a9b1-45120147df1f]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-daa85784-fb68-435d-adde-94f8c3c074a2 tempest-VolumesCloneNegativeTest-102730401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45bee4e1-332c-4576-95b2-a153c5f45eb2 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:21 devstack sudo[109539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45bee4e1-332c-4576-95b2-a153c5f45eb2 Aug 27 03:51:21 devstack sudo[109539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:21 devstack sudo[109534]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7db0020b-473f-420a-b8cf-a17126171936 1073741824" returned: 0 in 0.676s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Flow 'volume_create_manager' (04c82a2b-867c-4ae9-85d9-c3fffef0fba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d571bf4-0cee-4303-b085-3be24af9e3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7db0020b-473f-420a-b8cf-a17126171936 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d571bf4-0cee-4303-b085-3be24af9e3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-268733625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaf76cb8-4379-4d67-a77c-543db95dbadf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca222e7172e47c489f5bf57dfec1af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:51:21Z,use_quota=True,user_id='831203796fb64a26bb2ac65e32350835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3ef3fc-b46f-4d53-98d1-36043eecb94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3ef3fc-b46f-4d53-98d1-36043eecb94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de1f2bf-f0fe-4a36-a2e3-deda804f9f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de1f2bf-f0fe-4a36-a2e3-deda804f9f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaf76cb8-4379-4d67-a77c-543db95dbadf', 'volume_name': 'volume-eaf76cb8-4379-4d67-a77c-543db95dbadf', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b6641f-cc32-43cc-8700-08985fd110ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b6641f-cc32-43cc-8700-08985fd110ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:21 devstack sudo[109541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7db0020b-473f-420a-b8cf-a17126171936 Aug 27 03:51:21 devstack sudo[109541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73899f05-a45a-49f8-8476-22a608f5b488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:21 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Volume eaf76cb8-4379-4d67-a77c-543db95dbadf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaf76cb8-4379-4d67-a77c-543db95dbadf', 'volume_size': 1} Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:21 devstack sudo[109539]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-daa85784-fb68-435d-adde-94f8c3c074a2 tempest-VolumesCloneNegativeTest-102730401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45bee4e1-332c-4576-95b2-a153c5f45eb2" returned: 0 in 0.564s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-daa85784-fb68-435d-adde-94f8c3c074a2 tempest-VolumesCloneNegativeTest-102730401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45bee4e1-332c-4576-95b2-a153c5f45eb2 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:21 devstack sudo[109546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45bee4e1-332c-4576-95b2-a153c5f45eb2 Aug 27 03:51:21 devstack sudo[109546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:21 devstack sudo[109541]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7db0020b-473f-420a-b8cf-a17126171936" returned: 0 in 0.422s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:51:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.315s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-657153116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc65109-a0aa-4ccf-bb4b-485698af38b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca222e7172e47c489f5bf57dfec1af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:51:21Z,use_quota=True,user_id='831203796fb64a26bb2ac65e32350835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Creating volume 9dc65109-a0aa-4ccf-bb4b-485698af38b0 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:51:22 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9dc65109-a0aa-4ccf-bb4b-485698af38b0 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:22 devstack sudo[109549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9dc65109-a0aa-4ccf-bb4b-485698af38b0 1073741824 Aug 27 03:51:22 devstack sudo[109549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba90c1bf-90e3-4958-8c41-ebfb76a00dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7db0020b-473f-420a-b8cf-a17126171936', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34394b6a-d967-401e-9850-a8906fa390d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:22 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Volume volume-7db0020b-473f-420a-b8cf-a17126171936 (7db0020b-473f-420a-b8cf-a17126171936): created successfully Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34394b6a-d967-401e-9850-a8906fa390d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Flow 'volume_create_manager' (e48312df-b0cf-4500-a021-68999dff84ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:51:22 devstack sudo[109546]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-daa85784-fb68-435d-adde-94f8c3c074a2 tempest-VolumesCloneNegativeTest-102730401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-45bee4e1-332c-4576-95b2-a153c5f45eb2" returned: 0 in 0.336s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Flow 'volume_create_manager' (b8dc6e6f-5ca3-4fd7-bf9d-29607de6a151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd36681e-d7f3-4d43-b1ec-e1029d8bafc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-daa85784-fb68-435d-adde-94f8c3c074a2 tempest-VolumesCloneNegativeTest-102730401 None] Lock "cinder-quobyte-45bee4e1-332c-4576-95b2-a153c5f45eb2" released by "delete_volume" :: held 0.982s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:51:22 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-5fd15ffd-dfc3-4087-aad7-ac49a8951a1e tempest-CreateVolumesFromSnapshotTest-1438265473 None] Created volume successfully. Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd36681e-d7f3-4d43-b1ec-e1029d8bafc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2127474425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54cd576b-3f2d-4320-9248-209892874a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca222e7172e47c489f5bf57dfec1af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:51:22Z,use_quota=True,user_id='831203796fb64a26bb2ac65e32350835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce132f68-ec9e-4aff-a9d1-5406d7885ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce132f68-ec9e-4aff-a9d1-5406d7885ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10eb3c9c-a3b9-4dff-8005-3ee8651b2f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10eb3c9c-a3b9-4dff-8005-3ee8651b2f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54cd576b-3f2d-4320-9248-209892874a50', 'volume_name': 'volume-54cd576b-3f2d-4320-9248-209892874a50', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7efcb53e-b030-4f64-a9aa-44fa32d42987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7efcb53e-b030-4f64-a9aa-44fa32d42987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (507b685e-3206-49ac-83e1-ccd55b801dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:22 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Volume 54cd576b-3f2d-4320-9248-209892874a50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54cd576b-3f2d-4320-9248-209892874a50', 'volume_size': 1} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-daa85784-fb68-435d-adde-94f8c3c074a2 tempest-VolumesCloneNegativeTest-102730401 None] Created reservations ['8fd24063-6e1d-405f-812a-ac557ba17e6f', 'bbf860cc-2f9b-40a0-8f71-52c57efc3fa5', '6e7427d7-ed94-40f5-a647-f204dc191614', 'e59fc4e0-703c-4037-b6ad-a4e340776835'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-daa85784-fb68-435d-adde-94f8c3c074a2 tempest-VolumesCloneNegativeTest-102730401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-daa85784-fb68-435d-adde-94f8c3c074a2 tempest-VolumesCloneNegativeTest-102730401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-daa85784-fb68-435d-adde-94f8c3c074a2 tempest-VolumesCloneNegativeTest-102730401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-daa85784-fb68-435d-adde-94f8c3c074a2 tempest-VolumesCloneNegativeTest-102730401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-daa85784-fb68-435d-adde-94f8c3c074a2 tempest-VolumesCloneNegativeTest-102730401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-daa85784-fb68-435d-adde-94f8c3c074a2 tempest-VolumesCloneNegativeTest-102730401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:22 devstack sudo[109555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:51:22 devstack sudo[109555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:22 devstack sudo[109549]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9dc65109-a0aa-4ccf-bb4b-485698af38b0 1073741824" returned: 0 in 0.564s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9dc65109-a0aa-4ccf-bb4b-485698af38b0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:22 devstack sudo[109559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9dc65109-a0aa-4ccf-bb4b-485698af38b0 Aug 27 03:51:22 devstack sudo[109559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:22 devstack sudo[109555]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-daa85784-fb68-435d-adde-94f8c3c074a2 tempest-VolumesCloneNegativeTest-102730401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.328s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-daa85784-fb68-435d-adde-94f8c3c074a2 tempest-VolumesCloneNegativeTest-102730401 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:51:22 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-daa85784-fb68-435d-adde-94f8c3c074a2 tempest-VolumesCloneNegativeTest-102730401 None] Deleted volume successfully. Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-daa85784-fb68-435d-adde-94f8c3c074a2 tempest-VolumesCloneNegativeTest-102730401 None] Lock "cinder-45bee4e1-332c-4576-95b2-a153c5f45eb2-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:51:22 devstack sudo[109559]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9dc65109-a0aa-4ccf-bb4b-485698af38b0" returned: 0 in 0.270s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d7d6bff6-fd18-426a-832a-0c209509130d tempest-VolumesActionsTest-1878717002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.207s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (307742d4-8a6e-463d-b8ad-af9b6bfcbcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dc65109-a0aa-4ccf-bb4b-485698af38b0', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e7f776-7a72-4b7e-ae94-a8234e14d084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[429f030d-33f5-48be-b6b0-1c2f6db5438b]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d7d6bff6-fd18-426a-832a-0c209509130d tempest-VolumesActionsTest-1878717002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:22 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Volume volume-9dc65109-a0aa-4ccf-bb4b-485698af38b0 (9dc65109-a0aa-4ccf-bb4b-485698af38b0): created successfully Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e7f776-7a72-4b7e-ae94-a8234e14d084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Flow 'volume_create_manager' (41b7ee31-3e8b-43bc-850d-df022c2be430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:51:22 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-cbc88d6d-d676-4053-9ebb-a090c6557377 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Created volume successfully. Aug 27 03:51:23 devstack sudo[109562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 Aug 27 03:51:23 devstack sudo[109562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:23 devstack sudo[109562]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d7d6bff6-fd18-426a-832a-0c209509130d tempest-VolumesActionsTest-1878717002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3" returned: 0 in 0.404s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:23 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd70287-0859-4381-a57c-327d62bcb432]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:51:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d7d6bff6-fd18-426a-832a-0c209509130d tempest-VolumesActionsTest-1878717002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:23 devstack sudo[109568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 Aug 27 03:51:23 devstack sudo[109568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:23 devstack sudo[109568]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d7d6bff6-fd18-426a-832a-0c209509130d tempest-VolumesActionsTest-1878717002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3" returned: 0 in 0.621s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d7d6bff6-fd18-426a-832a-0c209509130d tempest-VolumesActionsTest-1878717002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 /opt/stack/data/cinder/conversion/c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3.temp_image.54a08525-5e24-4c2b-8d96-0ccde9816cbcyaeuoh7g.img {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:24 devstack sudo[109573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 /opt/stack/data/cinder/conversion/c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3.temp_image.54a08525-5e24-4c2b-8d96-0ccde9816cbcyaeuoh7g.img Aug 27 03:51:24 devstack sudo[109573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:29 devstack sudo[109573]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d7d6bff6-fd18-426a-832a-0c209509130d tempest-VolumesActionsTest-1878717002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 /opt/stack/data/cinder/conversion/c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3.temp_image.54a08525-5e24-4c2b-8d96-0ccde9816cbcyaeuoh7g.img" returned: 0 in 5.607s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:29 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6d7c46-c72a-4622-b529-0929efcb8d8d]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:51:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d7d6bff6-fd18-426a-832a-0c209509130d tempest-VolumesActionsTest-1878717002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:29 devstack sudo[109592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 Aug 27 03:51:29 devstack sudo[109592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:30 devstack sudo[109592]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d7d6bff6-fd18-426a-832a-0c209509130d tempest-VolumesActionsTest-1878717002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3" returned: 0 in 0.729s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:30 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-d7d6bff6-fd18-426a-832a-0c209509130d tempest-VolumesActionsTest-1878717002 None] Image conversion details: src /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3, size 1024.00 MB, duration 5.61 sec, destination /opt/stack/data/cinder/conversion/c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3.temp_image.54a08525-5e24-4c2b-8d96-0ccde9816cbcyaeuoh7g.img {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:51:30 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-d7d6bff6-fd18-426a-832a-0c209509130d tempest-VolumesActionsTest-1878717002 None] Converted 1024.00 MB image at 182.57 MB/s Aug 27 03:51:30 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-d7d6bff6-fd18-426a-832a-0c209509130d tempest-VolumesActionsTest-1878717002 None] 54a08525-5e24-4c2b-8d96-0ccde9816cbc was raw, no need to convert to raw {{(pid=94328) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 27 03:51:32 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=102,cinder:DELETE=10,cinder:UPDATE=126,cinder:INSERT=39 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:51:40 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:UPDATE=134,cinder:SELECT=116,cinder:INSERT=33,cinder:DELETE=13 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:51:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d7d6bff6-fd18-426a-832a-0c209509130d tempest-VolumesActionsTest-1878717002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.979s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d7d6bff6-fd18-426a-832a-0c209509130d tempest-VolumesActionsTest-1878717002 None] Uploaded volume to glance image-id: 54a08525-5e24-4c2b-8d96-0ccde9816cbc. {{(pid=94328) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 27 03:51:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 34.256s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-268733625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaf76cb8-4379-4d67-a77c-543db95dbadf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca222e7172e47c489f5bf57dfec1af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:51:21Z,use_quota=True,user_id='831203796fb64a26bb2ac65e32350835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:51:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Creating volume eaf76cb8-4379-4d67-a77c-543db95dbadf {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:51:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:51:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:51:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:51:55 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:51:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eaf76cb8-4379-4d67-a77c-543db95dbadf 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:55 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d7d6bff6-fd18-426a-832a-0c209509130d tempest-VolumesActionsTest-1878717002 None] Copy volume to image completed successfully. Aug 27 03:51:55 devstack sudo[109602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eaf76cb8-4379-4d67-a77c-543db95dbadf 1073741824 Aug 27 03:51:55 devstack sudo[109602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:56 devstack sudo[109602]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eaf76cb8-4379-4d67-a77c-543db95dbadf 1073741824" returned: 0 in 0.648s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eaf76cb8-4379-4d67-a77c-543db95dbadf {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:56 devstack sudo[109608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eaf76cb8-4379-4d67-a77c-543db95dbadf Aug 27 03:51:56 devstack sudo[109608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:56 devstack sudo[109608]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eaf76cb8-4379-4d67-a77c-543db95dbadf" returned: 0 in 0.389s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:51:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 34.792s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2127474425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54cd576b-3f2d-4320-9248-209892874a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca222e7172e47c489f5bf57dfec1af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:51:22Z,use_quota=True,user_id='831203796fb64a26bb2ac65e32350835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:51:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Creating volume 54cd576b-3f2d-4320-9248-209892874a50 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:51:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:51:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:51:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:51:57 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:51:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-54cd576b-3f2d-4320-9248-209892874a50 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:57 devstack sudo[109611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-54cd576b-3f2d-4320-9248-209892874a50 1073741824 Aug 27 03:51:57 devstack sudo[109611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73899f05-a45a-49f8-8476-22a608f5b488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaf76cb8-4379-4d67-a77c-543db95dbadf', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6751a017-1960-4606-a7b2-d58ca962296b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:57 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Volume volume-eaf76cb8-4379-4d67-a77c-543db95dbadf (eaf76cb8-4379-4d67-a77c-543db95dbadf): created successfully Aug 27 03:51:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6751a017-1960-4606-a7b2-d58ca962296b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Flow 'volume_create_manager' (04c82a2b-867c-4ae9-85d9-c3fffef0fba1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:51:57 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-913c2288-6e01-4b54-8592-8171193f5bfb tempest-CreateVolumesFromSnapshotTest-1438265473 None] Created volume successfully. Aug 27 03:51:57 devstack sudo[109611]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-54cd576b-3f2d-4320-9248-209892874a50 1073741824" returned: 0 in 0.629s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-54cd576b-3f2d-4320-9248-209892874a50 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:57 devstack sudo[109617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-54cd576b-3f2d-4320-9248-209892874a50 Aug 27 03:51:57 devstack sudo[109617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:58 devstack sudo[109617]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-54cd576b-3f2d-4320-9248-209892874a50" returned: 0 in 0.325s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:51:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:51:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (507b685e-3206-49ac-83e1-ccd55b801dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54cd576b-3f2d-4320-9248-209892874a50', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a316ee-e832-49b5-b752-1e94de2eefe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:51:58 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Volume volume-54cd576b-3f2d-4320-9248-209892874a50 (54cd576b-3f2d-4320-9248-209892874a50): created successfully Aug 27 03:51:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a316ee-e832-49b5-b752-1e94de2eefe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:51:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Flow 'volume_create_manager' (b8dc6e6f-5ca3-4fd7-bf9d-29607de6a151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:51:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:51:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:51:58 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[72764396-477a-435d-a613-0b28bb0dfd75]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:51:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:58 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f63f23f1-9335-415a-a940-8fa4030c8894 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Created volume successfully. Aug 27 03:51:58 devstack sudo[109620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 Aug 27 03:51:58 devstack sudo[109620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:58 devstack sudo[109620]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3" returned: 0 in 0.420s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:58 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[96aa9026-d7e6-47d1-86c0-fa4fcc7a0bee]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:51:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:58 devstack sudo[109625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 Aug 27 03:51:58 devstack sudo[109625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:59 devstack sudo[109625]: pam_unix(sudo:session): session closed for user root Aug 27 03:51:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3" returned: 0 in 0.492s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:51:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 /opt/stack/data/cinder/conversion/c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3.temp_image.95df963c-b559-4df1-b298-6d60ffb9d814jqcemo3r.img {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:51:59 devstack sudo[109631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 /opt/stack/data/cinder/conversion/c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3.temp_image.95df963c-b559-4df1-b298-6d60ffb9d814jqcemo3r.img Aug 27 03:51:59 devstack sudo[109631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:51:59 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9a1963db-be11-4da0-ad95-8ce1cb664a8b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "cinder-54cd576b-3f2d-4320-9248-209892874a50-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:51:59 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9a1963db-be11-4da0-ad95-8ce1cb664a8b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-54cd576b-3f2d-4320-9248-209892874a50-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:51:59 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9a1963db-be11-4da0-ad95-8ce1cb664a8b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "cinder-quobyte-54cd576b-3f2d-4320-9248-209892874a50" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:51:59 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9a1963db-be11-4da0-ad95-8ce1cb664a8b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-quobyte-54cd576b-3f2d-4320-9248-209892874a50" acquired by "delete_volume" :: waited 0.052s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:51:59 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f77d4fc-9490-4428-ae88-35727dcbfdeb]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:51:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9a1963db-be11-4da0-ad95-8ce1cb664a8b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-54cd576b-3f2d-4320-9248-209892874a50 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:00 devstack sudo[109643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-54cd576b-3f2d-4320-9248-209892874a50 Aug 27 03:52:00 devstack sudo[109643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:00 devstack sudo[109643]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9a1963db-be11-4da0-ad95-8ce1cb664a8b tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-54cd576b-3f2d-4320-9248-209892874a50" returned: 0 in 0.907s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9a1963db-be11-4da0-ad95-8ce1cb664a8b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-54cd576b-3f2d-4320-9248-209892874a50 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:00 devstack sudo[109650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-54cd576b-3f2d-4320-9248-209892874a50 Aug 27 03:52:00 devstack sudo[109650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:01 devstack sudo[109650]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9a1963db-be11-4da0-ad95-8ce1cb664a8b tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-54cd576b-3f2d-4320-9248-209892874a50" returned: 0 in 1.023s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:01 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9a1963db-be11-4da0-ad95-8ce1cb664a8b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-quobyte-54cd576b-3f2d-4320-9248-209892874a50" released by "delete_volume" :: held 2.076s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:02 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-9a1963db-be11-4da0-ad95-8ce1cb664a8b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Created reservations ['88f36aea-1f49-424f-9600-df58a68375b9', 'b1a26444-0e65-4d6b-ae4b-1b5206ae826c', '760accce-f788-4dfa-8007-8bd74e798322', '2ec7e755-fbcf-48fd-9aec-919924e1d42b'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:52:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9a1963db-be11-4da0-ad95-8ce1cb664a8b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9a1963db-be11-4da0-ad95-8ce1cb664a8b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:02 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-9a1963db-be11-4da0-ad95-8ce1cb664a8b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:52:02 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-9a1963db-be11-4da0-ad95-8ce1cb664a8b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:52:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9a1963db-be11-4da0-ad95-8ce1cb664a8b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9a1963db-be11-4da0-ad95-8ce1cb664a8b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:02 devstack sudo[109653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:52:02 devstack sudo[109653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:03 devstack sudo[109653]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9a1963db-be11-4da0-ad95-8ce1cb664a8b tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.805s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:03 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-9a1963db-be11-4da0-ad95-8ce1cb664a8b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:52:03 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-9a1963db-be11-4da0-ad95-8ce1cb664a8b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Deleted volume successfully. Aug 27 03:52:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9a1963db-be11-4da0-ad95-8ce1cb664a8b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-54cd576b-3f2d-4320-9248-209892874a50-delete_volume" released by "delete_volume" :: held 3.604s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f871262c-8fb4-4eb1-9ad2-4e456b64380b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "cinder-eaf76cb8-4379-4d67-a77c-543db95dbadf-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f871262c-8fb4-4eb1-9ad2-4e456b64380b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-eaf76cb8-4379-4d67-a77c-543db95dbadf-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f871262c-8fb4-4eb1-9ad2-4e456b64380b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "cinder-quobyte-eaf76cb8-4379-4d67-a77c-543db95dbadf" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f871262c-8fb4-4eb1-9ad2-4e456b64380b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-quobyte-eaf76cb8-4379-4d67-a77c-543db95dbadf" acquired by "delete_volume" :: waited 0.048s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:03 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[652cdd82-5761-468b-95f9-881b69c1f170]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f871262c-8fb4-4eb1-9ad2-4e456b64380b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eaf76cb8-4379-4d67-a77c-543db95dbadf {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:04 devstack sudo[109662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eaf76cb8-4379-4d67-a77c-543db95dbadf Aug 27 03:52:04 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:04 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:04 devstack sudo[109631]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f871262c-8fb4-4eb1-9ad2-4e456b64380b tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eaf76cb8-4379-4d67-a77c-543db95dbadf" returned: 0 in 0.942s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f871262c-8fb4-4eb1-9ad2-4e456b64380b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eaf76cb8-4379-4d67-a77c-543db95dbadf {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 /opt/stack/data/cinder/conversion/c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3.temp_image.95df963c-b559-4df1-b298-6d60ffb9d814jqcemo3r.img" returned: 0 in 5.756s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:04 devstack sudo[109668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eaf76cb8-4379-4d67-a77c-543db95dbadf Aug 27 03:52:04 devstack sudo[109668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:04 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f93efbd-7fd4-4e3e-adaa-b98cd94b806d]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:05 devstack sudo[109670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 Aug 27 03:52:05 devstack sudo[109670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:05 devstack sudo[109668]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f871262c-8fb4-4eb1-9ad2-4e456b64380b tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eaf76cb8-4379-4d67-a77c-543db95dbadf" returned: 0 in 0.378s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f871262c-8fb4-4eb1-9ad2-4e456b64380b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-quobyte-eaf76cb8-4379-4d67-a77c-543db95dbadf" released by "delete_volume" :: held 1.421s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:05 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-f871262c-8fb4-4eb1-9ad2-4e456b64380b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Created reservations ['0c75a475-257d-431b-b8e9-e930abd2bdea', '49cf24f7-640f-49f1-aa9f-b105c1b430b6', 'ad13626e-22d1-46b5-9407-772f0da87483', '9a3820d9-e1f6-489a-aad4-53de82282dd1'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:52:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f871262c-8fb4-4eb1-9ad2-4e456b64380b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f871262c-8fb4-4eb1-9ad2-4e456b64380b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f871262c-8fb4-4eb1-9ad2-4e456b64380b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:52:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f871262c-8fb4-4eb1-9ad2-4e456b64380b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:52:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f871262c-8fb4-4eb1-9ad2-4e456b64380b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f871262c-8fb4-4eb1-9ad2-4e456b64380b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:05 devstack sudo[109675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:52:05 devstack sudo[109675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:05 devstack sudo[109670]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3" returned: 0 in 0.820s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:05 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] Image conversion details: src /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/conversion/c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3.temp_image.95df963c-b559-4df1-b298-6d60ffb9d814jqcemo3r.img {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:52:05 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] Converted 1024.00 MB image at 177.84 MB/s Aug 27 03:52:05 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] 95df963c-b559-4df1-b298-6d60ffb9d814 was raw, converting to qcow2 {{(pid=94328) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 27 03:52:05 devstack sudo[109675]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f871262c-8fb4-4eb1-9ad2-4e456b64380b tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.279s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:05 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-f871262c-8fb4-4eb1-9ad2-4e456b64380b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:52:05 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f871262c-8fb4-4eb1-9ad2-4e456b64380b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Deleted volume successfully. Aug 27 03:52:05 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d27c106-499d-4333-94ac-1ae40aa91030]: (4, 'raw') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3.temp_image.95df963c-b559-4df1-b298-6d60ffb9d814jqcemo3r.img {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f871262c-8fb4-4eb1-9ad2-4e456b64380b tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-eaf76cb8-4379-4d67-a77c-543db95dbadf-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e78c34af-746b-477a-a575-df2815fd9757 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "cinder-9dc65109-a0aa-4ccf-bb4b-485698af38b0-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e78c34af-746b-477a-a575-df2815fd9757 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-9dc65109-a0aa-4ccf-bb4b-485698af38b0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:06 devstack sudo[109682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3.temp_image.95df963c-b559-4df1-b298-6d60ffb9d814jqcemo3r.img Aug 27 03:52:06 devstack sudo[109682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e78c34af-746b-477a-a575-df2815fd9757 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "cinder-quobyte-9dc65109-a0aa-4ccf-bb4b-485698af38b0" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e78c34af-746b-477a-a575-df2815fd9757 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-quobyte-9dc65109-a0aa-4ccf-bb4b-485698af38b0" acquired by "delete_volume" :: waited 0.027s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:06 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[751c6f04-8b3e-4b3a-a131-c2d84d6eb8e1]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e78c34af-746b-477a-a575-df2815fd9757 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9dc65109-a0aa-4ccf-bb4b-485698af38b0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:06 devstack sudo[109684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9dc65109-a0aa-4ccf-bb4b-485698af38b0 Aug 27 03:52:06 devstack sudo[109684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:06 devstack sudo[109682]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3.temp_image.95df963c-b559-4df1-b298-6d60ffb9d814jqcemo3r.img" returned: 0 in 0.728s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3.temp_image.95df963c-b559-4df1-b298-6d60ffb9d814jqcemo3r.img {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:06 devstack sudo[109688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3.temp_image.95df963c-b559-4df1-b298-6d60ffb9d814jqcemo3r.img Aug 27 03:52:06 devstack sudo[109688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:06 devstack sudo[109684]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e78c34af-746b-477a-a575-df2815fd9757 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9dc65109-a0aa-4ccf-bb4b-485698af38b0" returned: 0 in 0.720s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e78c34af-746b-477a-a575-df2815fd9757 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9dc65109-a0aa-4ccf-bb4b-485698af38b0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:06 devstack sudo[109693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9dc65109-a0aa-4ccf-bb4b-485698af38b0 Aug 27 03:52:06 devstack sudo[109693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:07 devstack sudo[109688]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3.temp_image.95df963c-b559-4df1-b298-6d60ffb9d814jqcemo3r.img" returned: 1 in 0.517s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3.temp_image.95df963c-b559-4df1-b298-6d60ffb9d814jqcemo3r.img' failed. Not Retrying. {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 27 03:52:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3.temp_image.95df963c-b559-4df1-b298-6d60ffb9d814jqcemo3r.img /opt/stack/data/cinder/conversion/vol_upload_cnsxxjp6 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:07 devstack sudo[109698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3.temp_image.95df963c-b559-4df1-b298-6d60ffb9d814jqcemo3r.img /opt/stack/data/cinder/conversion/vol_upload_cnsxxjp6 Aug 27 03:52:07 devstack sudo[109698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:07 devstack sudo[109693]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e78c34af-746b-477a-a575-df2815fd9757 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9dc65109-a0aa-4ccf-bb4b-485698af38b0" returned: 0 in 0.593s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:07 devstack sudo[109698]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3.temp_image.95df963c-b559-4df1-b298-6d60ffb9d814jqcemo3r.img /opt/stack/data/cinder/conversion/vol_upload_cnsxxjp6" returned: 0 in 0.533s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:07 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] Image conversion details: src /opt/stack/data/cinder/conversion/c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3.temp_image.95df963c-b559-4df1-b298-6d60ffb9d814jqcemo3r.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_cnsxxjp6 {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:52:07 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 27 03:52:07 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[5254d025-f85b-4d45-9beb-d4c924446340]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_cnsxxjp6 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e78c34af-746b-477a-a575-df2815fd9757 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-quobyte-9dc65109-a0aa-4ccf-bb4b-485698af38b0" released by "delete_volume" :: held 1.449s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:07 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-e78c34af-746b-477a-a575-df2815fd9757 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Created reservations ['6366e3b6-79b3-47a0-bdf4-8a1b627e87b8', 'ad9d15e8-110c-4fe0-a2e6-8efb1a3b9e47', '5fa93383-c4c5-4c57-a288-e1be9c4c990d', '8ef12658-2ed8-4992-af09-f903668a1b34'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:52:07 devstack sudo[109705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_cnsxxjp6 Aug 27 03:52:07 devstack sudo[109705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e78c34af-746b-477a-a575-df2815fd9757 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e78c34af-746b-477a-a575-df2815fd9757 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e78c34af-746b-477a-a575-df2815fd9757 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:52:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e78c34af-746b-477a-a575-df2815fd9757 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:52:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e78c34af-746b-477a-a575-df2815fd9757 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e78c34af-746b-477a-a575-df2815fd9757 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:07 devstack sudo[109708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:52:07 devstack sudo[109708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:08 devstack sudo[109705]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_cnsxxjp6" returned: 0 in 0.585s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f2e57d1a-fa86-4de7-a10f-8b6ad0495443 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "cinder-7db0020b-473f-420a-b8cf-a17126171936-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:08 devstack sudo[109708]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e78c34af-746b-477a-a575-df2815fd9757 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.529s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:08 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-e78c34af-746b-477a-a575-df2815fd9757 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:52:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f2e57d1a-fa86-4de7-a10f-8b6ad0495443 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-7db0020b-473f-420a-b8cf-a17126171936-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:08 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e78c34af-746b-477a-a575-df2815fd9757 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Deleted volume successfully. Aug 27 03:52:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e78c34af-746b-477a-a575-df2815fd9757 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-9dc65109-a0aa-4ccf-bb4b-485698af38b0-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f2e57d1a-fa86-4de7-a10f-8b6ad0495443 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "cinder-quobyte-7db0020b-473f-420a-b8cf-a17126171936" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f2e57d1a-fa86-4de7-a10f-8b6ad0495443 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-quobyte-7db0020b-473f-420a-b8cf-a17126171936" acquired by "delete_volume" :: waited 0.035s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:08 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd61ffc-4e0f-4f38-bd3b-4d79a91c2beb]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2e57d1a-fa86-4de7-a10f-8b6ad0495443 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7db0020b-473f-420a-b8cf-a17126171936 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:08 devstack sudo[109734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7db0020b-473f-420a-b8cf-a17126171936 Aug 27 03:52:08 devstack sudo[109734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:09 devstack sudo[109734]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2e57d1a-fa86-4de7-a10f-8b6ad0495443 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7db0020b-473f-420a-b8cf-a17126171936" returned: 0 in 0.716s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2e57d1a-fa86-4de7-a10f-8b6ad0495443 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7db0020b-473f-420a-b8cf-a17126171936 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:09 devstack sudo[109759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7db0020b-473f-420a-b8cf-a17126171936 Aug 27 03:52:09 devstack sudo[109759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:09 devstack sudo[109759]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2e57d1a-fa86-4de7-a10f-8b6ad0495443 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7db0020b-473f-420a-b8cf-a17126171936" returned: 0 in 0.401s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f2e57d1a-fa86-4de7-a10f-8b6ad0495443 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-quobyte-7db0020b-473f-420a-b8cf-a17126171936" released by "delete_volume" :: held 1.188s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:09 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-f2e57d1a-fa86-4de7-a10f-8b6ad0495443 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Created reservations ['9f5b7b9c-c274-47b6-801f-b87c2de2b31b', 'fb33b722-cf92-4a60-a7ba-b5c3febd1d89', '533df79c-7ca8-4a1a-80d4-717286c97f01', '0642f125-ceb5-4b11-9b33-af4ebe917116'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:52:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f2e57d1a-fa86-4de7-a10f-8b6ad0495443 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f2e57d1a-fa86-4de7-a10f-8b6ad0495443 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f2e57d1a-fa86-4de7-a10f-8b6ad0495443 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:52:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f2e57d1a-fa86-4de7-a10f-8b6ad0495443 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:52:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f2e57d1a-fa86-4de7-a10f-8b6ad0495443 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2e57d1a-fa86-4de7-a10f-8b6ad0495443 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:09 devstack sudo[109775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:52:09 devstack sudo[109775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:10 devstack sudo[109775]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2e57d1a-fa86-4de7-a10f-8b6ad0495443 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.410s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:10 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-f2e57d1a-fa86-4de7-a10f-8b6ad0495443 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:52:10 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f2e57d1a-fa86-4de7-a10f-8b6ad0495443 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Deleted volume successfully. Aug 27 03:52:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f2e57d1a-fa86-4de7-a10f-8b6ad0495443 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-7db0020b-473f-420a-b8cf-a17126171936-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.524s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] Uploaded volume to glance image-id: 95df963c-b559-4df1-b298-6d60ffb9d814. {{(pid=94328) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 27 03:52:10 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-7159dfe4-5de6-4056-87d8-3b00248da5c0 tempest-VolumesActionsTest-1878717002 None] Copy volume to image completed successfully. Aug 27 03:52:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7abf36b5-89ba-48ef-9b2d-2135bae7a954 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "cinder-431ff464-bd22-4f48-9062-6adfd5193807-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7abf36b5-89ba-48ef-9b2d-2135bae7a954 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-431ff464-bd22-4f48-9062-6adfd5193807-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7abf36b5-89ba-48ef-9b2d-2135bae7a954 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "cinder-quobyte-431ff464-bd22-4f48-9062-6adfd5193807" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7abf36b5-89ba-48ef-9b2d-2135bae7a954 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-quobyte-431ff464-bd22-4f48-9062-6adfd5193807" acquired by "delete_volume" :: waited 0.060s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:11 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[76aa9653-a4fd-4f5b-9527-165189574650]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7abf36b5-89ba-48ef-9b2d-2135bae7a954 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-431ff464-bd22-4f48-9062-6adfd5193807 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:11 devstack sudo[109794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-431ff464-bd22-4f48-9062-6adfd5193807 Aug 27 03:52:11 devstack sudo[109794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:11 devstack sudo[109794]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7abf36b5-89ba-48ef-9b2d-2135bae7a954 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-431ff464-bd22-4f48-9062-6adfd5193807" returned: 0 in 0.784s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7abf36b5-89ba-48ef-9b2d-2135bae7a954 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-431ff464-bd22-4f48-9062-6adfd5193807 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:11 devstack sudo[109832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-431ff464-bd22-4f48-9062-6adfd5193807 Aug 27 03:52:11 devstack sudo[109832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:12 devstack sudo[109832]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7abf36b5-89ba-48ef-9b2d-2135bae7a954 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-431ff464-bd22-4f48-9062-6adfd5193807" returned: 0 in 0.515s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7abf36b5-89ba-48ef-9b2d-2135bae7a954 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-quobyte-431ff464-bd22-4f48-9062-6adfd5193807" released by "delete_volume" :: held 1.366s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:12 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-7abf36b5-89ba-48ef-9b2d-2135bae7a954 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Created reservations ['2a2200b3-6e22-4f90-86b8-2e7a98f0550d', 'e1263be5-be9e-4db9-af40-1eb052301c70', 'dcf8b844-5fa2-4c64-9f92-96e902a47329', '39cfaed0-ba32-4411-9f75-5440707b5605'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:52:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-35e75d2a-4801-4d0e-b9c8-bb718488eada tempest-VolumesActionsTest-1878717002 None] Acquiring lock "cinder-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-35e75d2a-4801-4d0e-b9c8-bb718488eada tempest-VolumesActionsTest-1878717002 None] Lock "cinder-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-35e75d2a-4801-4d0e-b9c8-bb718488eada tempest-VolumesActionsTest-1878717002 None] Acquiring lock "cinder-quobyte-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-35e75d2a-4801-4d0e-b9c8-bb718488eada tempest-VolumesActionsTest-1878717002 None] Lock "cinder-quobyte-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3" acquired by "delete_volume" :: waited 0.044s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7abf36b5-89ba-48ef-9b2d-2135bae7a954 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7abf36b5-89ba-48ef-9b2d-2135bae7a954 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7abf36b5-89ba-48ef-9b2d-2135bae7a954 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:52:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7abf36b5-89ba-48ef-9b2d-2135bae7a954 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:52:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7abf36b5-89ba-48ef-9b2d-2135bae7a954 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7abf36b5-89ba-48ef-9b2d-2135bae7a954 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:12 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13fbb76-3274-4f42-9afd-a6acf4d72d57]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-35e75d2a-4801-4d0e-b9c8-bb718488eada tempest-VolumesActionsTest-1878717002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:12 devstack sudo[109869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:52:12 devstack sudo[109869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:13 devstack sudo[109871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 Aug 27 03:52:13 devstack sudo[109871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-899b1c7f-3702-459d-8301-bfdd88fd0046 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "cinder-00f486a9-cbec-49a8-9450-a4dfed6cb9cc-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-899b1c7f-3702-459d-8301-bfdd88fd0046 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-00f486a9-cbec-49a8-9450-a4dfed6cb9cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-899b1c7f-3702-459d-8301-bfdd88fd0046 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "cinder-quobyte-17b9439e-eaae-4e34-afbe-5ad7cdcbe120" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-899b1c7f-3702-459d-8301-bfdd88fd0046 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-quobyte-17b9439e-eaae-4e34-afbe-5ad7cdcbe120" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-899b1c7f-3702-459d-8301-bfdd88fd0046 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "cinder-quobyte-00f486a9-cbec-49a8-9450-a4dfed6cb9cc" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:13 devstack sudo[109869]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7abf36b5-89ba-48ef-9b2d-2135bae7a954 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.651s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:13 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-7abf36b5-89ba-48ef-9b2d-2135bae7a954 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:52:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-899b1c7f-3702-459d-8301-bfdd88fd0046 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-quobyte-00f486a9-cbec-49a8-9450-a4dfed6cb9cc" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:13 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-899b1c7f-3702-459d-8301-bfdd88fd0046 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Deleting offline snapshot 00f486a9-cbec-49a8-9450-a4dfed6cb9cc of volume 17b9439e-eaae-4e34-afbe-5ad7cdcbe120 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:52:13 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-899b1c7f-3702-459d-8301-bfdd88fd0046 tempest-CreateVolumesFromSnapshotTest-1438265473 None] snapshot_file for this snap is: volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.00f486a9-cbec-49a8-9450-a4dfed6cb9cc {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:52:13 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-7abf36b5-89ba-48ef-9b2d-2135bae7a954 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Deleted volume successfully. Aug 27 03:52:13 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb261235-c104-4577-8c8a-d863d65a7dd7]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-899b1c7f-3702-459d-8301-bfdd88fd0046 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.00f486a9-cbec-49a8-9450-a4dfed6cb9cc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7abf36b5-89ba-48ef-9b2d-2135bae7a954 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-431ff464-bd22-4f48-9062-6adfd5193807-delete_volume" released by "delete_volume" :: held 2.826s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:13 devstack sudo[109953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.00f486a9-cbec-49a8-9450-a4dfed6cb9cc Aug 27 03:52:13 devstack sudo[109953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:13 devstack sudo[109871]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-35e75d2a-4801-4d0e-b9c8-bb718488eada tempest-VolumesActionsTest-1878717002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3" returned: 0 in 1.008s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-35e75d2a-4801-4d0e-b9c8-bb718488eada tempest-VolumesActionsTest-1878717002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:13 devstack sudo[109959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3 Aug 27 03:52:13 devstack sudo[109959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:14 devstack sudo[109953]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-899b1c7f-3702-459d-8301-bfdd88fd0046 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.00f486a9-cbec-49a8-9450-a4dfed6cb9cc" returned: 0 in 0.701s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-899b1c7f-3702-459d-8301-bfdd88fd0046 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:52:14 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf3fff9-f2a6-44cf-a221-056f9897e518]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-899b1c7f-3702-459d-8301-bfdd88fd0046 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:14 devstack sudo[109959]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-35e75d2a-4801-4d0e-b9c8-bb718488eada tempest-VolumesActionsTest-1878717002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3" returned: 0 in 0.604s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:14 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-35e75d2a-4801-4d0e-b9c8-bb718488eada tempest-VolumesActionsTest-1878717002 None] Lock "cinder-quobyte-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3" released by "delete_volume" :: held 1.719s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:14 devstack sudo[109980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120 Aug 27 03:52:14 devstack sudo[109980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:14 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-35e75d2a-4801-4d0e-b9c8-bb718488eada tempest-VolumesActionsTest-1878717002 None] Created reservations ['aae64a48-28c8-430e-9ef7-ec6c7a63bf25', '409b56fe-3657-42eb-95d0-ec11493fa084', 'ce67e532-1b26-4aad-8c7b-948a916a8598', '8e9e6a2a-b039-4290-a16d-055435293eb7'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:52:14 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:52:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:52:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:52:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-35e75d2a-4801-4d0e-b9c8-bb718488eada tempest-VolumesActionsTest-1878717002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-35e75d2a-4801-4d0e-b9c8-bb718488eada tempest-VolumesActionsTest-1878717002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-35e75d2a-4801-4d0e-b9c8-bb718488eada tempest-VolumesActionsTest-1878717002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:52:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-35e75d2a-4801-4d0e-b9c8-bb718488eada tempest-VolumesActionsTest-1878717002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:52:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-35e75d2a-4801-4d0e-b9c8-bb718488eada tempest-VolumesActionsTest-1878717002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-35e75d2a-4801-4d0e-b9c8-bb718488eada tempest-VolumesActionsTest-1878717002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:15 devstack sudo[109995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:52:15 devstack sudo[109995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:15 devstack sudo[110003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:52:15 devstack sudo[110003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:15 devstack sudo[109980]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-899b1c7f-3702-459d-8301-bfdd88fd0046 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120" returned: 0 in 1.076s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-899b1c7f-3702-459d-8301-bfdd88fd0046 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.00f486a9-cbec-49a8-9450-a4dfed6cb9cc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:15 devstack sudo[110008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.00f486a9-cbec-49a8-9450-a4dfed6cb9cc Aug 27 03:52:15 devstack sudo[110008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:15 devstack sudo[110003]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-35e75d2a-4801-4d0e-b9c8-bb718488eada tempest-VolumesActionsTest-1878717002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.777s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-35e75d2a-4801-4d0e-b9c8-bb718488eada tempest-VolumesActionsTest-1878717002 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:52:15 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-35e75d2a-4801-4d0e-b9c8-bb718488eada tempest-VolumesActionsTest-1878717002 None] Deleted volume successfully. Aug 27 03:52:15 devstack sudo[109995]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.962s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:52:15 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager._thread_info {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:52:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread count: 28 {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 03:52:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread info: [<_MainThread(MainThread, started 134250325188736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 03:52:15 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-35e75d2a-4801-4d0e-b9c8-bb718488eada tempest-VolumesActionsTest-1878717002 None] Lock "cinder-c9c5e1f4-e0ab-4f2a-acf1-b342eb6a8fe3-delete_volume" released by "delete_volume" :: held 3.311s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:16 devstack sudo[110008]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-899b1c7f-3702-459d-8301-bfdd88fd0046 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.00f486a9-cbec-49a8-9450-a4dfed6cb9cc" returned: 0 in 1.177s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-899b1c7f-3702-459d-8301-bfdd88fd0046 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.00f486a9-cbec-49a8-9450-a4dfed6cb9cc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:16 devstack sudo[110028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.00f486a9-cbec-49a8-9450-a4dfed6cb9cc Aug 27 03:52:16 devstack sudo[110028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:17 devstack sudo[110028]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-899b1c7f-3702-459d-8301-bfdd88fd0046 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120.00f486a9-cbec-49a8-9450-a4dfed6cb9cc" returned: 0 in 0.777s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:17 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-899b1c7f-3702-459d-8301-bfdd88fd0046 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-quobyte-00f486a9-cbec-49a8-9450-a4dfed6cb9cc" released by "_delete_snapshot" :: held 4.039s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:17 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-899b1c7f-3702-459d-8301-bfdd88fd0046 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-quobyte-17b9439e-eaae-4e34-afbe-5ad7cdcbe120" released by "delete_snapshot" :: held 4.124s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:17 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-899b1c7f-3702-459d-8301-bfdd88fd0046 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Created reservations ['e0cd9af1-0324-46d2-8dba-3f184918fa88', 'a38a141c-fc58-4b94-b507-ccd478baf0c3', '649eb5ae-30f6-4213-98fd-05719d12ec2f', 'e0344bc1-facd-4de1-b5d9-8cff1b348e94'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:52:18 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-899b1c7f-3702-459d-8301-bfdd88fd0046 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Delete snapshot completed successfully. Aug 27 03:52:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-899b1c7f-3702-459d-8301-bfdd88fd0046 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-00f486a9-cbec-49a8-9450-a4dfed6cb9cc-delete_snapshot" released by "delete_snapshot" :: held 4.689s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2f4de01d-37a7-44ed-8dd1-63cd6b7dda16 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "cinder-17b9439e-eaae-4e34-afbe-5ad7cdcbe120-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2f4de01d-37a7-44ed-8dd1-63cd6b7dda16 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-17b9439e-eaae-4e34-afbe-5ad7cdcbe120-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2f4de01d-37a7-44ed-8dd1-63cd6b7dda16 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "cinder-quobyte-17b9439e-eaae-4e34-afbe-5ad7cdcbe120" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2f4de01d-37a7-44ed-8dd1-63cd6b7dda16 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-quobyte-17b9439e-eaae-4e34-afbe-5ad7cdcbe120" acquired by "delete_volume" :: waited 0.026s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:19 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac30da0-a4c8-47e5-be52-efbece8de4d8]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2f4de01d-37a7-44ed-8dd1-63cd6b7dda16 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:19 devstack sudo[110039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120 Aug 27 03:52:19 devstack sudo[110039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:19 devstack sudo[110039]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2f4de01d-37a7-44ed-8dd1-63cd6b7dda16 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120" returned: 0 in 0.610s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2f4de01d-37a7-44ed-8dd1-63cd6b7dda16 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:19 devstack sudo[110044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120 Aug 27 03:52:19 devstack sudo[110044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:20 devstack sudo[110044]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2f4de01d-37a7-44ed-8dd1-63cd6b7dda16 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-17b9439e-eaae-4e34-afbe-5ad7cdcbe120" returned: 0 in 0.580s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2f4de01d-37a7-44ed-8dd1-63cd6b7dda16 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-quobyte-17b9439e-eaae-4e34-afbe-5ad7cdcbe120" released by "delete_volume" :: held 1.335s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:20 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-2f4de01d-37a7-44ed-8dd1-63cd6b7dda16 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Created reservations ['a58572b7-559d-4b48-b9a8-9f791b507812', '0244ec51-fcc4-4a3d-9f40-2fb3c1216a97', '74d1936f-50e7-4815-93d1-9e64b61f749a', 'a3a011e2-7cac-4d83-a08a-9f0cc6946d4a'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:52:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2f4de01d-37a7-44ed-8dd1-63cd6b7dda16 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2f4de01d-37a7-44ed-8dd1-63cd6b7dda16 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2f4de01d-37a7-44ed-8dd1-63cd6b7dda16 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:52:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2f4de01d-37a7-44ed-8dd1-63cd6b7dda16 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:52:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2f4de01d-37a7-44ed-8dd1-63cd6b7dda16 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2f4de01d-37a7-44ed-8dd1-63cd6b7dda16 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:20 devstack sudo[110049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:52:20 devstack sudo[110049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:21 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:52:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Flow 'volume_create_manager' (d915e581-4b17-4d0e-9a4d-0d0632ebcfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:52:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54eb70c0-0063-45d6-b298-db0cf57824a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54eb70c0-0063-45d6-b298-db0cf57824a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-617353013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f72bd8f-c6c5-4443-b687-d2ad440aaba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faef85ba3a314d029d57853b1c3aec63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:52:21Z,use_quota=True,user_id='a1c2456335ef4536968e969548c0038b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad7ff23-5f38-4bb6-9afc-4d29bbc11072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad7ff23-5f38-4bb6-9afc-4d29bbc11072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b32c8c91-65e8-4e30-86a3-c380beb2a926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b32c8c91-65e8-4e30-86a3-c380beb2a926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f72bd8f-c6c5-4443-b687-d2ad440aaba6', 'volume_name': 'volume-2f72bd8f-c6c5-4443-b687-d2ad440aaba6', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:21 devstack sudo[110049]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e23297-373f-4d59-93bf-719da259f722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e23297-373f-4d59-93bf-719da259f722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd77c1e1-5e7e-44a3-83d2-460edddbbabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:21 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Volume 2f72bd8f-c6c5-4443-b687-d2ad440aaba6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f72bd8f-c6c5-4443-b687-d2ad440aaba6', 'volume_size': 1} Aug 27 03:52:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:21 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-617353013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f72bd8f-c6c5-4443-b687-d2ad440aaba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faef85ba3a314d029d57853b1c3aec63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:52:21Z,use_quota=True,user_id='a1c2456335ef4536968e969548c0038b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:52:21 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Creating volume 2f72bd8f-c6c5-4443-b687-d2ad440aaba6 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:52:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:21 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:52:21 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:52:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:21 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:52:21 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:52:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2f72bd8f-c6c5-4443-b687-d2ad440aaba6 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2f4de01d-37a7-44ed-8dd1-63cd6b7dda16 tempest-CreateVolumesFromSnapshotTest-1438265473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 1.055s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:21 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-2f4de01d-37a7-44ed-8dd1-63cd6b7dda16 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:52:21 devstack sudo[110054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2f72bd8f-c6c5-4443-b687-d2ad440aaba6 1073741824 Aug 27 03:52:21 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-2f4de01d-37a7-44ed-8dd1-63cd6b7dda16 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Deleted volume successfully. Aug 27 03:52:21 devstack sudo[110054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:22 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2f4de01d-37a7-44ed-8dd1-63cd6b7dda16 tempest-CreateVolumesFromSnapshotTest-1438265473 None] Lock "cinder-17b9439e-eaae-4e34-afbe-5ad7cdcbe120-delete_volume" released by "delete_volume" :: held 3.067s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:22 devstack sudo[110054]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2f72bd8f-c6c5-4443-b687-d2ad440aaba6 1073741824" returned: 0 in 0.832s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2f72bd8f-c6c5-4443-b687-d2ad440aaba6 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:22 devstack sudo[110060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2f72bd8f-c6c5-4443-b687-d2ad440aaba6 Aug 27 03:52:22 devstack sudo[110060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:23 devstack sudo[110060]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2f72bd8f-c6c5-4443-b687-d2ad440aaba6" returned: 0 in 0.418s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:23 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:52:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd77c1e1-5e7e-44a3-83d2-460edddbbabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f72bd8f-c6c5-4443-b687-d2ad440aaba6', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbc671d1-601b-4767-95d3-c9d06f1b1717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:23 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Volume volume-2f72bd8f-c6c5-4443-b687-d2ad440aaba6 (2f72bd8f-c6c5-4443-b687-d2ad440aaba6): created successfully Aug 27 03:52:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbc671d1-601b-4767-95d3-c9d06f1b1717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Flow 'volume_create_manager' (d915e581-4b17-4d0e-9a4d-0d0632ebcfb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:52:23 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-fa54ff03-34a8-48cd-928a-a18259d92e46 tempest-TestMinimumBasicScenario-1972705584 None] Created volume successfully. Aug 27 03:52:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-237b4c9e-a0c6-4d91-b542-942cfaceb763 req-76235e9a-8e84-4dce-a393-a08f5beef192 tempest-TestMinimumBasicScenario-1972705584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-237b4c9e-a0c6-4d91-b542-942cfaceb763 req-76235e9a-8e84-4dce-a393-a08f5beef192 tempest-TestMinimumBasicScenario-1972705584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-237b4c9e-a0c6-4d91-b542-942cfaceb763 req-76235e9a-8e84-4dce-a393-a08f5beef192 tempest-TestMinimumBasicScenario-1972705584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-237b4c9e-a0c6-4d91-b542-942cfaceb763 req-76235e9a-8e84-4dce-a393-a08f5beef192 tempest-TestMinimumBasicScenario-1972705584 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac', 'name': 'volume-2f72bd8f-c6c5-4443-b687-d2ad440aaba6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb5f3191-c319-410b-a1a1-1816fe0bae3b', 'enforce_multipath': True} {{(pid=94328) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 27 03:52:26 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-237b4c9e-a0c6-4d91-b542-942cfaceb763 req-76235e9a-8e84-4dce-a393-a08f5beef192 tempest-TestMinimumBasicScenario-1972705584 None] attachment_update completed successfully. Aug 27 03:52:27 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:52:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Flow 'volume_create_manager' (9061e966-1afd-4cb1-84e3-6d47c8adbf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:52:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037e5c4c-c6e5-497e-973b-0c26e87f9a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037e5c4c-c6e5-497e-973b-0c26e87f9a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1851618382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabf2e1d-4298-4b32-adcf-b41f60a24add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5d9bd8a5924e57affd68c49e72f758',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:52:28Z,use_quota=True,user_id='f9cda6ae698642b09d6532aa75094cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0d314d3-e4f8-4832-865f-14d4eb0bdce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0d314d3-e4f8-4832-865f-14d4eb0bdce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc498c12-3ee3-4b64-a705-2f6c6a62a5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc498c12-3ee3-4b64-a705-2f6c6a62a5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dabf2e1d-4298-4b32-adcf-b41f60a24add', 'volume_name': 'volume-dabf2e1d-4298-4b32-adcf-b41f60a24add', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4b7b72-ac35-4548-ba94-b8f71665b015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4b7b72-ac35-4548-ba94-b8f71665b015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc2e207-f526-4402-8739-2e107713e097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:28 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Volume dabf2e1d-4298-4b32-adcf-b41f60a24add: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dabf2e1d-4298-4b32-adcf-b41f60a24add', 'volume_size': 1} Aug 27 03:52:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:28 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1851618382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabf2e1d-4298-4b32-adcf-b41f60a24add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5d9bd8a5924e57affd68c49e72f758',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:52:28Z,use_quota=True,user_id='f9cda6ae698642b09d6532aa75094cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:52:28 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Creating volume dabf2e1d-4298-4b32-adcf-b41f60a24add {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:52:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:28 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:52:28 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:52:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:28 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:52:28 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:52:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:28 devstack sudo[110467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add 1073741824 Aug 27 03:52:28 devstack sudo[110467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:28 devstack sudo[110467]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add 1073741824" returned: 0 in 0.776s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:28 devstack sudo[110473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add Aug 27 03:52:28 devstack sudo[110473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:29 devstack sudo[110473]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add" returned: 0 in 0.489s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:52:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc2e207-f526-4402-8739-2e107713e097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dabf2e1d-4298-4b32-adcf-b41f60a24add', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ffac31e-1ebe-454e-9919-223abfb68560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:29 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Volume volume-dabf2e1d-4298-4b32-adcf-b41f60a24add (dabf2e1d-4298-4b32-adcf-b41f60a24add): created successfully Aug 27 03:52:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ffac31e-1ebe-454e-9919-223abfb68560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Flow 'volume_create_manager' (9061e966-1afd-4cb1-84e3-6d47c8adbf43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:52:29 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-c9611f34-1cdd-4eeb-acb4-fd1f5d2462bf tempest-VolumeDependencyTests-776003185 None] Created volume successfully. Aug 27 03:52:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3fca26c5-9ca0-466a-b2a9-5e4d3c008f53 tempest-VolumeDependencyTests-776003185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3fca26c5-9ca0-466a-b2a9-5e4d3c008f53 tempest-VolumeDependencyTests-776003185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-3fca26c5-9ca0-466a-b2a9-5e4d3c008f53 tempest-VolumeDependencyTests-776003185 None] Creating offline snapshot 6ea6cae0-8ae9-4bf9-a195-64d031a8117f of volume dabf2e1d-4298-4b32-adcf-b41f60a24add {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:52:30 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf81893-bafa-4924-baf6-cff7bfbfbd26]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3fca26c5-9ca0-466a-b2a9-5e4d3c008f53 tempest-VolumeDependencyTests-776003185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:30 devstack sudo[110524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add Aug 27 03:52:30 devstack sudo[110524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:31 devstack sudo[110524]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3fca26c5-9ca0-466a-b2a9-5e4d3c008f53 tempest-VolumeDependencyTests-776003185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add" returned: 0 in 0.715s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3fca26c5-9ca0-466a-b2a9-5e4d3c008f53 tempest-VolumeDependencyTests-776003185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.6ea6cae0-8ae9-4bf9-a195-64d031a8117f 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:31 devstack sudo[110546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.6ea6cae0-8ae9-4bf9-a195-64d031a8117f 1G Aug 27 03:52:31 devstack sudo[110546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:31 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:52:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Flow 'volume_create_manager' (e07bdcec-a318-4b56-becc-5b5ac37c90ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:52:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6235b295-0b9b-49c9-897c-75bf781516cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6235b295-0b9b-49c9-897c-75bf781516cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2074438656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb6a91d-67d8-4a4c-a439-18133454e4dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d5fda5b16b490aaa7bafab4983abbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:52:31Z,use_quota=True,user_id='b46e137a606240c5ac180fc65b8ac84e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15583aaf-41be-4e69-948e-451910f3f486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15583aaf-41be-4e69-948e-451910f3f486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4126e1-e4e1-4f0d-a757-509ff2ed7606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4126e1-e4e1-4f0d-a757-509ff2ed7606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4eb6a91d-67d8-4a4c-a439-18133454e4dd', 'volume_name': 'volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d261f1c7-f4e1-414f-9a36-65c0a6446aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d261f1c7-f4e1-414f-9a36-65c0a6446aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c9ebd2-7411-409f-80b7-a6f18bef9b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:31 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Volume 4eb6a91d-67d8-4a4c-a439-18133454e4dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd', 'volume_size': 1} Aug 27 03:52:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:31 devstack sudo[110546]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3fca26c5-9ca0-466a-b2a9-5e4d3c008f53 tempest-VolumeDependencyTests-776003185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.6ea6cae0-8ae9-4bf9-a195-64d031a8117f 1G" returned: 0 in 0.545s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3fca26c5-9ca0-466a-b2a9-5e4d3c008f53 tempest-VolumeDependencyTests-776003185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dabf2e1d-4298-4b32-adcf-b41f60a24add -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.6ea6cae0-8ae9-4bf9-a195-64d031a8117f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:31 devstack sudo[110556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dabf2e1d-4298-4b32-adcf-b41f60a24add -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.6ea6cae0-8ae9-4bf9-a195-64d031a8117f Aug 27 03:52:31 devstack sudo[110556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:32 devstack sudo[110556]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3fca26c5-9ca0-466a-b2a9-5e4d3c008f53 tempest-VolumeDependencyTests-776003185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dabf2e1d-4298-4b32-adcf-b41f60a24add -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.6ea6cae0-8ae9-4bf9-a195-64d031a8117f" returned: 0 in 0.285s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:32 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-3fca26c5-9ca0-466a-b2a9-5e4d3c008f53 tempest-VolumeDependencyTests-776003185 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.6ea6cae0-8ae9-4bf9-a195-64d031a8117f is being set with open permissions: ugo+rw Aug 27 03:52:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3fca26c5-9ca0-466a-b2a9-5e4d3c008f53 tempest-VolumeDependencyTests-776003185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.6ea6cae0-8ae9-4bf9-a195-64d031a8117f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:32 devstack sudo[110561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.6ea6cae0-8ae9-4bf9-a195-64d031a8117f Aug 27 03:52:32 devstack sudo[110561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:32 devstack sudo[110561]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3fca26c5-9ca0-466a-b2a9-5e4d3c008f53 tempest-VolumeDependencyTests-776003185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.6ea6cae0-8ae9-4bf9-a195-64d031a8117f" returned: 0 in 0.269s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3fca26c5-9ca0-466a-b2a9-5e4d3c008f53 tempest-VolumeDependencyTests-776003185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:32 devstack sudo[110564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.info Aug 27 03:52:32 devstack sudo[110564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:32 devstack sudo[110564]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3fca26c5-9ca0-466a-b2a9-5e4d3c008f53 tempest-VolumeDependencyTests-776003185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.info" returned: 0 in 0.270s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:32 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-3fca26c5-9ca0-466a-b2a9-5e4d3c008f53 tempest-VolumeDependencyTests-776003185 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.info is being set with open permissions: ugo+rw Aug 27 03:52:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3fca26c5-9ca0-466a-b2a9-5e4d3c008f53 tempest-VolumeDependencyTests-776003185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:32 devstack sudo[110568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.info Aug 27 03:52:32 devstack sudo[110568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:32 devstack sudo[110568]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3fca26c5-9ca0-466a-b2a9-5e4d3c008f53 tempest-VolumeDependencyTests-776003185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.info" returned: 0 in 0.254s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3fca26c5-9ca0-466a-b2a9-5e4d3c008f53 tempest-VolumeDependencyTests-776003185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.455s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.327s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2074438656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb6a91d-67d8-4a4c-a439-18133454e4dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d5fda5b16b490aaa7bafab4983abbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:52:31Z,use_quota=True,user_id='b46e137a606240c5ac180fc65b8ac84e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:52:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Creating volume 4eb6a91d-67d8-4a4c-a439-18133454e4dd {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:52:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:52:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:52:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:52:33 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:52:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:33 devstack sudo[110571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd 1073741824 Aug 27 03:52:33 devstack sudo[110571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:33 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-3fca26c5-9ca0-466a-b2a9-5e4d3c008f53 tempest-VolumeDependencyTests-776003185 None] Create snapshot completed successfully Aug 27 03:52:33 devstack sudo[110571]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd 1073741824" returned: 0 in 0.546s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:33 devstack sudo[110580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd Aug 27 03:52:33 devstack sudo[110580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:33 devstack sudo[110580]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd" returned: 0 in 0.285s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:52:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c9ebd2-7411-409f-80b7-a6f18bef9b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a410977-fe58-4afb-adb7-484a366f1f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:33 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Volume volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd (4eb6a91d-67d8-4a4c-a439-18133454e4dd): created successfully Aug 27 03:52:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a410977-fe58-4afb-adb7-484a366f1f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Flow 'volume_create_manager' (e07bdcec-a318-4b56-becc-5b5ac37c90ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:52:33 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-4c4d2340-b998-44a6-8df6-ba00084d0853 tempest-VolumesCloneTest-659664578 None] Created volume successfully. Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Flow 'volume_create_manager' (d7f4a048-2130-4b35-9025-2883e7380132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1dfa34-80d9-40ee-9d65-baab259af79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1dfa34-80d9-40ee-9d65-baab259af79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1080186241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fcbeeef-c90a-4cb8-be48-7df380226ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5d9bd8a5924e57affd68c49e72f758',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6ea6cae0-8ae9-4bf9-a195-64d031a8117f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:52:34Z,use_quota=True,user_id='f9cda6ae698642b09d6532aa75094cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b35c609-b186-440e-afb9-235c63cb8c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b35c609-b186-440e-afb9-235c63cb8c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d262caa-3f5f-40fe-89d8-ff9403355d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d262caa-3f5f-40fe-89d8-ff9403355d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9fcbeeef-c90a-4cb8-be48-7df380226ec6', 'volume_name': 'volume-9fcbeeef-c90a-4cb8-be48-7df380226ec6', 'volume_size': 1, 'snapshot_id': '6ea6cae0-8ae9-4bf9-a195-64d031a8117f'}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d896309e-ec9d-4e1c-8a8b-4806558cfbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d896309e-ec9d-4e1c-8a8b-4806558cfbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc23fa95-2890-485e-b5a5-98eb96251070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:34 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Volume 9fcbeeef-c90a-4cb8-be48-7df380226ec6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9fcbeeef-c90a-4cb8-be48-7df380226ec6', 'volume_size': 1, 'snapshot_id': '6ea6cae0-8ae9-4bf9-a195-64d031a8117f'} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Acquiring lock "cinder-quobyte-6ea6cae0-8ae9-4bf9-a195-64d031a8117f-9fcbeeef-c90a-4cb8-be48-7df380226ec6" by "_create_volume_from_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Lock "cinder-quobyte-6ea6cae0-8ae9-4bf9-a195-64d031a8117f-9fcbeeef-c90a-4cb8-be48-7df380226ec6" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Creating volume 9fcbeeef-c90a-4cb8-be48-7df380226ec6 from snapshot 6ea6cae0-8ae9-4bf9-a195-64d031a8117f {{(pid=94328) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Acquiring lock "cinder-quobyte-9fcbeeef-c90a-4cb8-be48-7df380226ec6" by "_copy_volume_from_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Lock "cinder-quobyte-9fcbeeef-c90a-4cb8-be48-7df380226ec6" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] snapshot: 6ea6cae0-8ae9-4bf9-a195-64d031a8117f, volume: 9fcbeeef-c90a-4cb8-be48-7df380226ec6, {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea700aa1-3fd5-438a-ad8e-4251a0de0c94]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.6ea6cae0-8ae9-4bf9-a195-64d031a8117f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:34 devstack sudo[110583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.6ea6cae0-8ae9-4bf9-a195-64d031a8117f Aug 27 03:52:34 devstack sudo[110583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:34 devstack sudo[110583]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.6ea6cae0-8ae9-4bf9-a195-64d031a8117f" returned: 0 in 0.409s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dabf2e1d-4298-4b32-adcf-b41f60a24add(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2b95af-aa22-4be3-b096-415d56c3f2f4]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:35 devstack sudo[110588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add Aug 27 03:52:35 devstack sudo[110588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:35 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:52:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Flow 'volume_create_manager' (4de8fdc4-47af-463d-a1d9-8b9e8d6f2c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:52:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d99e257-5434-4b3b-b74d-6996a0b7df9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d99e257-5434-4b3b-b74d-6996a0b7df9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-740062168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3d07b33-3897-429c-a0c6-70dc209f5f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d5fda5b16b490aaa7bafab4983abbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:52:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=4eb6a91d-67d8-4a4c-a439-18133454e4dd,status='creating',terminated_at=None,updated_at=2026-08-27T01:52:35Z,use_quota=True,user_id='b46e137a606240c5ac180fc65b8ac84e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a4dd9b-9e04-4d73-8ce2-b0fb22a08ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a4dd9b-9e04-4d73-8ce2-b0fb22a08ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f8b26b-2647-4f81-83c7-cf3f9eb05fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f8b26b-2647-4f81-83c7-cf3f9eb05fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f3d07b33-3897-429c-a0c6-70dc209f5f92', 'volume_name': 'volume-f3d07b33-3897-429c-a0c6-70dc209f5f92', 'volume_size': 2, 'source_volid': '4eb6a91d-67d8-4a4c-a439-18133454e4dd', 'source_volstatus': 'available'}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4fcc28-dc35-4cd5-8869-e931c421a534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4fcc28-dc35-4cd5-8869-e931c421a534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c58bb93-083a-4dc6-ae51-089f45087b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:35 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Volume f3d07b33-3897-429c-a0c6-70dc209f5f92: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f3d07b33-3897-429c-a0c6-70dc209f5f92', 'volume_size': 2, 'source_volid': '4eb6a91d-67d8-4a4c-a439-18133454e4dd', 'source_volstatus': 'available'} Aug 27 03:52:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:35 devstack sudo[110588]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add" returned: 0 in 0.440s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] will copy from snapshot at /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 27 03:52:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Creating direct copy from snapshot {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 27 03:52:35 devstack cinder-volume[94328]: DEBUG cinder.utils [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Path /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9fcbeeef-c90a-4cb8-be48-7df380226ec6 not found in is_blk_device check {{(pid=94328) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 27 03:52:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9fcbeeef-c90a-4cb8-be48-7df380226ec6 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:35 devstack sudo[110593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9fcbeeef-c90a-4cb8-be48-7df380226ec6 Aug 27 03:52:35 devstack sudo[110593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:41 devstack sudo[110593]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9fcbeeef-c90a-4cb8-be48-7df380226ec6" returned: 0 in 5.626s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:41 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Image conversion details: src /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9fcbeeef-c90a-4cb8-be48-7df380226ec6 {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:52:41 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Converted 1024.00 MB image at 181.90 MB/s Aug 27 03:52:41 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9fcbeeef-c90a-4cb8-be48-7df380226ec6 is being set with open permissions: ugo+rw Aug 27 03:52:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9fcbeeef-c90a-4cb8-be48-7df380226ec6 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:41 devstack sudo[110608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9fcbeeef-c90a-4cb8-be48-7df380226ec6 Aug 27 03:52:41 devstack sudo[110608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:41 devstack sudo[110608]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9fcbeeef-c90a-4cb8-be48-7df380226ec6" returned: 0 in 0.264s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Lock "cinder-quobyte-9fcbeeef-c90a-4cb8-be48-7df380226ec6" released by "_copy_volume_from_snapshot" :: held 6.860s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Lock "cinder-quobyte-6ea6cae0-8ae9-4bf9-a195-64d031a8117f-9fcbeeef-c90a-4cb8-be48-7df380226ec6" released by "_create_volume_from_snapshot" :: held 6.968s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.988s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.114s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:41 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Cloning volume 4eb6a91d-67d8-4a4c-a439-18133454e4dd to volume f3d07b33-3897-429c-a0c6-70dc209f5f92 Aug 27 03:52:41 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc23fa95-2890-485e-b5a5-98eb96251070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fcbeeef-c90a-4cb8-be48-7df380226ec6', 'volume_size': 1, 'snapshot_id': '6ea6cae0-8ae9-4bf9-a195-64d031a8117f'}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:41 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763fd1c9-0457-466b-9b9d-e754c8d49405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Creating offline snapshot fc6890b9-e529-4c3e-9c6b-549efb7c475a of volume 4eb6a91d-67d8-4a4c-a439-18133454e4dd {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:52:41 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Volume volume-9fcbeeef-c90a-4cb8-be48-7df380226ec6 (9fcbeeef-c90a-4cb8-be48-7df380226ec6): created successfully Aug 27 03:52:41 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763fd1c9-0457-466b-9b9d-e754c8d49405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:41 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Flow 'volume_create_manager' (d7f4a048-2130-4b35-9025-2883e7380132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:52:41 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[435665f8-3740-4cac-bc9c-7d8d4149b80d]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:41 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-8bd126fc-fe6b-4910-86a8-fce84420114c tempest-VolumeDependencyTests-776003185 None] Created volume successfully. Aug 27 03:52:41 devstack sudo[110615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd Aug 27 03:52:41 devstack sudo[110615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:42 devstack sudo[110615]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd" returned: 0 in 0.605s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.fc6890b9-e529-4c3e-9c6b-549efb7c475a 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ae215dfd-b50a-465b-b65f-ab2339b3c978 tempest-VolumeDependencyTests-776003185 None] Acquiring lock "cinder-6ea6cae0-8ae9-4bf9-a195-64d031a8117f-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:42 devstack sudo[110620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.fc6890b9-e529-4c3e-9c6b-549efb7c475a 1G Aug 27 03:52:42 devstack sudo[110620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ae215dfd-b50a-465b-b65f-ab2339b3c978 tempest-VolumeDependencyTests-776003185 None] Lock "cinder-6ea6cae0-8ae9-4bf9-a195-64d031a8117f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ae215dfd-b50a-465b-b65f-ab2339b3c978 tempest-VolumeDependencyTests-776003185 None] Acquiring lock "cinder-quobyte-dabf2e1d-4298-4b32-adcf-b41f60a24add" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ae215dfd-b50a-465b-b65f-ab2339b3c978 tempest-VolumeDependencyTests-776003185 None] Lock "cinder-quobyte-dabf2e1d-4298-4b32-adcf-b41f60a24add" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ae215dfd-b50a-465b-b65f-ab2339b3c978 tempest-VolumeDependencyTests-776003185 None] Acquiring lock "cinder-quobyte-6ea6cae0-8ae9-4bf9-a195-64d031a8117f" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ae215dfd-b50a-465b-b65f-ab2339b3c978 tempest-VolumeDependencyTests-776003185 None] Lock "cinder-quobyte-6ea6cae0-8ae9-4bf9-a195-64d031a8117f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:42 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-ae215dfd-b50a-465b-b65f-ab2339b3c978 tempest-VolumeDependencyTests-776003185 None] Deleting offline snapshot 6ea6cae0-8ae9-4bf9-a195-64d031a8117f of volume dabf2e1d-4298-4b32-adcf-b41f60a24add {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:52:42 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-ae215dfd-b50a-465b-b65f-ab2339b3c978 tempest-VolumeDependencyTests-776003185 None] snapshot_file for this snap is: volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.6ea6cae0-8ae9-4bf9-a195-64d031a8117f {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:52:42 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dfabc5-e1d3-44d9-a79a-7a23ce6af199]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ae215dfd-b50a-465b-b65f-ab2339b3c978 tempest-VolumeDependencyTests-776003185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.6ea6cae0-8ae9-4bf9-a195-64d031a8117f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:42 devstack sudo[110622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.6ea6cae0-8ae9-4bf9-a195-64d031a8117f Aug 27 03:52:42 devstack sudo[110622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:42 devstack sudo[110620]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.fc6890b9-e529-4c3e-9c6b-549efb7c475a 1G" returned: 0 in 0.557s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.fc6890b9-e529-4c3e-9c6b-549efb7c475a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:42 devstack sudo[110629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.fc6890b9-e529-4c3e-9c6b-549efb7c475a Aug 27 03:52:42 devstack sudo[110629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:42 devstack sudo[110622]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ae215dfd-b50a-465b-b65f-ab2339b3c978 tempest-VolumeDependencyTests-776003185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.6ea6cae0-8ae9-4bf9-a195-64d031a8117f" returned: 0 in 0.563s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:42 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-ae215dfd-b50a-465b-b65f-ab2339b3c978 tempest-VolumeDependencyTests-776003185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dabf2e1d-4298-4b32-adcf-b41f60a24add(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:52:42 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa48513-62b6-41d0-9bdf-9ad5763b2614]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ae215dfd-b50a-465b-b65f-ab2339b3c978 tempest-VolumeDependencyTests-776003185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Flow 'volume_create_manager' (f228988d-c8f5-40e3-afb7-64f8e83825b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ed7cbd5-de9a-4062-a28f-de697b849772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ed7cbd5-de9a-4062-a28f-de697b849772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1338514187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf42cbd1-2faf-4f72-9efb-439cac4afd75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9585e1e5d341f196e16db82c94a707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:52:43Z,use_quota=True,user_id='dd6642fa8885421eac8ecd171e2e8847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59d96c5-d0cb-4d7b-b82a-e37b98dda98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59d96c5-d0cb-4d7b-b82a-e37b98dda98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62519c3d-11a5-45cd-8fce-b95d6111da6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62519c3d-11a5-45cd-8fce-b95d6111da6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf42cbd1-2faf-4f72-9efb-439cac4afd75', 'volume_name': 'volume-bf42cbd1-2faf-4f72-9efb-439cac4afd75', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0467e1f-eb6d-482a-9b97-3077dba702f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0467e1f-eb6d-482a-9b97-3077dba702f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:43 devstack sudo[110632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add Aug 27 03:52:43 devstack sudo[110632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f89bdeb9-14c2-48bd-98dd-604d441e40de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:43 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Volume bf42cbd1-2faf-4f72-9efb-439cac4afd75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf42cbd1-2faf-4f72-9efb-439cac4afd75', 'volume_size': 1} Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:43 devstack sudo[110629]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.fc6890b9-e529-4c3e-9c6b-549efb7c475a" returned: 0 in 0.391s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:43 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.fc6890b9-e529-4c3e-9c6b-549efb7c475a is being set with open permissions: ugo+rw Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.fc6890b9-e529-4c3e-9c6b-549efb7c475a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:43 devstack sudo[110638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.fc6890b9-e529-4c3e-9c6b-549efb7c475a Aug 27 03:52:43 devstack sudo[110638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:43 devstack sudo[110638]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.fc6890b9-e529-4c3e-9c6b-549efb7c475a" returned: 0 in 0.267s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:43 devstack sudo[110643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.info Aug 27 03:52:43 devstack sudo[110643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:43 devstack sudo[110632]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ae215dfd-b50a-465b-b65f-ab2339b3c978 tempest-VolumeDependencyTests-776003185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add" returned: 0 in 0.588s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ae215dfd-b50a-465b-b65f-ab2339b3c978 tempest-VolumeDependencyTests-776003185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.6ea6cae0-8ae9-4bf9-a195-64d031a8117f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:43 devstack sudo[110646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.6ea6cae0-8ae9-4bf9-a195-64d031a8117f Aug 27 03:52:43 devstack sudo[110646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:43 devstack sudo[110643]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.info" returned: 0 in 0.251s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:43 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.info is being set with open permissions: ugo+rw Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:43 devstack sudo[110649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.info Aug 27 03:52:43 devstack sudo[110649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:43 devstack sudo[110646]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ae215dfd-b50a-465b-b65f-ab2339b3c978 tempest-VolumeDependencyTests-776003185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.6ea6cae0-8ae9-4bf9-a195-64d031a8117f" returned: 0 in 0.354s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ae215dfd-b50a-465b-b65f-ab2339b3c978 tempest-VolumeDependencyTests-776003185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.6ea6cae0-8ae9-4bf9-a195-64d031a8117f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:43 devstack sudo[110655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.6ea6cae0-8ae9-4bf9-a195-64d031a8117f Aug 27 03:52:43 devstack sudo[110655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:43 devstack sudo[110649]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.info" returned: 0 in 0.269s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Acquiring lock "cinder-quobyte-f3d07b33-3897-429c-a0c6-70dc209f5f92" by "_copy_volume_from_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Lock "cinder-quobyte-f3d07b33-3897-429c-a0c6-70dc209f5f92" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] snapshot: fc6890b9-e529-4c3e-9c6b-549efb7c475a, volume: f3d07b33-3897-429c-a0c6-70dc209f5f92, {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 27 03:52:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:52:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:52:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:44 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d62684-9b6f-412f-b2ab-d41547ea2aef]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.fc6890b9-e529-4c3e-9c6b-549efb7c475a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:44 devstack sudo[110657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.fc6890b9-e529-4c3e-9c6b-549efb7c475a Aug 27 03:52:44 devstack sudo[110657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:44 devstack sudo[110655]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ae215dfd-b50a-465b-b65f-ab2339b3c978 tempest-VolumeDependencyTests-776003185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add.6ea6cae0-8ae9-4bf9-a195-64d031a8117f" returned: 0 in 0.258s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ae215dfd-b50a-465b-b65f-ab2339b3c978 tempest-VolumeDependencyTests-776003185 None] Lock "cinder-quobyte-6ea6cae0-8ae9-4bf9-a195-64d031a8117f" released by "_delete_snapshot" :: held 1.931s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ae215dfd-b50a-465b-b65f-ab2339b3c978 tempest-VolumeDependencyTests-776003185 None] Lock "cinder-quobyte-dabf2e1d-4298-4b32-adcf-b41f60a24add" released by "delete_snapshot" :: held 1.964s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:44 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-ae215dfd-b50a-465b-b65f-ab2339b3c978 tempest-VolumeDependencyTests-776003185 None] Created reservations ['09298172-9cb6-4d6c-bc09-1b36fdcb91ed', '84e5bcc3-f66a-4fa1-9321-d32fcd162fdb', '40661412-da1f-4832-8242-80870d93a216', '475c64d2-1eed-4e80-81cd-b258892ab41c'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:52:44 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-ae215dfd-b50a-465b-b65f-ab2339b3c978 tempest-VolumeDependencyTests-776003185 None] Delete snapshot completed successfully. Aug 27 03:52:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ae215dfd-b50a-465b-b65f-ab2339b3c978 tempest-VolumeDependencyTests-776003185 None] Lock "cinder-6ea6cae0-8ae9-4bf9-a195-64d031a8117f-delete_snapshot" released by "delete_snapshot" :: held 2.149s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:44 devstack sudo[110657]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.fc6890b9-e529-4c3e-9c6b-549efb7c475a" returned: 0 in 0.410s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:52:44 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[4748dd6e-7a0f-4207-b354-3ab3d6be72cb]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:44 devstack sudo[110663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd Aug 27 03:52:44 devstack sudo[110663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:44 devstack sudo[110663]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd" returned: 0 in 0.371s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] will copy from snapshot at /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 27 03:52:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Creating direct copy from snapshot {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 27 03:52:44 devstack cinder-volume[94328]: DEBUG cinder.utils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Path /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f3d07b33-3897-429c-a0c6-70dc209f5f92 not found in is_blk_device check {{(pid=94328) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 27 03:52:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f3d07b33-3897-429c-a0c6-70dc209f5f92 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:44 devstack sudo[110668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f3d07b33-3897-429c-a0c6-70dc209f5f92 Aug 27 03:52:44 devstack sudo[110668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-39e383fe-cdcc-46e7-98eb-9089fd37d6c2 tempest-VolumeDependencyTests-776003185 None] Acquiring lock "cinder-dabf2e1d-4298-4b32-adcf-b41f60a24add-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-39e383fe-cdcc-46e7-98eb-9089fd37d6c2 tempest-VolumeDependencyTests-776003185 None] Lock "cinder-dabf2e1d-4298-4b32-adcf-b41f60a24add-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-39e383fe-cdcc-46e7-98eb-9089fd37d6c2 tempest-VolumeDependencyTests-776003185 None] Acquiring lock "cinder-quobyte-dabf2e1d-4298-4b32-adcf-b41f60a24add" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:46 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-39e383fe-cdcc-46e7-98eb-9089fd37d6c2 tempest-VolumeDependencyTests-776003185 None] Lock "cinder-quobyte-dabf2e1d-4298-4b32-adcf-b41f60a24add" acquired by "delete_volume" :: waited 0.046s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:46 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[618157c0-f791-4941-b081-49770aa4aed4]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-39e383fe-cdcc-46e7-98eb-9089fd37d6c2 tempest-VolumeDependencyTests-776003185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:46 devstack sudo[110691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add Aug 27 03:52:46 devstack sudo[110691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:46 devstack sudo[110691]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-39e383fe-cdcc-46e7-98eb-9089fd37d6c2 tempest-VolumeDependencyTests-776003185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add" returned: 0 in 0.757s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-39e383fe-cdcc-46e7-98eb-9089fd37d6c2 tempest-VolumeDependencyTests-776003185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:46 devstack sudo[110701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add Aug 27 03:52:46 devstack sudo[110701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:47 devstack sudo[110701]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-39e383fe-cdcc-46e7-98eb-9089fd37d6c2 tempest-VolumeDependencyTests-776003185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dabf2e1d-4298-4b32-adcf-b41f60a24add" returned: 0 in 0.734s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:47 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-39e383fe-cdcc-46e7-98eb-9089fd37d6c2 tempest-VolumeDependencyTests-776003185 None] Lock "cinder-quobyte-dabf2e1d-4298-4b32-adcf-b41f60a24add" released by "delete_volume" :: held 1.696s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:47 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-39e383fe-cdcc-46e7-98eb-9089fd37d6c2 tempest-VolumeDependencyTests-776003185 None] Created reservations ['ea09d078-642f-4f96-8f95-468edc3202d7', '4c319f35-03ef-4ffe-a0ab-3dec58d4203d', 'de9f010b-f6d0-4775-9a17-2b15e57755e3', 'f07aab23-edbe-4337-b874-5909c51cf5c3'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:52:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-39e383fe-cdcc-46e7-98eb-9089fd37d6c2 tempest-VolumeDependencyTests-776003185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-39e383fe-cdcc-46e7-98eb-9089fd37d6c2 tempest-VolumeDependencyTests-776003185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:47 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-39e383fe-cdcc-46e7-98eb-9089fd37d6c2 tempest-VolumeDependencyTests-776003185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:52:47 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-39e383fe-cdcc-46e7-98eb-9089fd37d6c2 tempest-VolumeDependencyTests-776003185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:52:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-39e383fe-cdcc-46e7-98eb-9089fd37d6c2 tempest-VolumeDependencyTests-776003185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-39e383fe-cdcc-46e7-98eb-9089fd37d6c2 tempest-VolumeDependencyTests-776003185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:48 devstack sudo[110742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:52:48 devstack sudo[110742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-61eeb8ea-3c5f-4b49-8ad8-27d9267315f5 tempest-VolumeDependencyTests-776003185 None] Acquiring lock "cinder-9fcbeeef-c90a-4cb8-be48-7df380226ec6-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-61eeb8ea-3c5f-4b49-8ad8-27d9267315f5 tempest-VolumeDependencyTests-776003185 None] Lock "cinder-9fcbeeef-c90a-4cb8-be48-7df380226ec6-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-61eeb8ea-3c5f-4b49-8ad8-27d9267315f5 tempest-VolumeDependencyTests-776003185 None] Acquiring lock "cinder-quobyte-9fcbeeef-c90a-4cb8-be48-7df380226ec6" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-61eeb8ea-3c5f-4b49-8ad8-27d9267315f5 tempest-VolumeDependencyTests-776003185 None] Lock "cinder-quobyte-9fcbeeef-c90a-4cb8-be48-7df380226ec6" acquired by "delete_volume" :: waited 0.028s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:48 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d484083-1eb6-4410-954e-ade370c5a0e4]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-61eeb8ea-3c5f-4b49-8ad8-27d9267315f5 tempest-VolumeDependencyTests-776003185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9fcbeeef-c90a-4cb8-be48-7df380226ec6 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:48 devstack sudo[110746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9fcbeeef-c90a-4cb8-be48-7df380226ec6 Aug 27 03:52:48 devstack sudo[110746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:48 devstack sudo[110742]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-39e383fe-cdcc-46e7-98eb-9089fd37d6c2 tempest-VolumeDependencyTests-776003185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.674s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:48 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-39e383fe-cdcc-46e7-98eb-9089fd37d6c2 tempest-VolumeDependencyTests-776003185 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:52:48 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-39e383fe-cdcc-46e7-98eb-9089fd37d6c2 tempest-VolumeDependencyTests-776003185 None] Deleted volume successfully. Aug 27 03:52:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-39e383fe-cdcc-46e7-98eb-9089fd37d6c2 tempest-VolumeDependencyTests-776003185 None] Lock "cinder-dabf2e1d-4298-4b32-adcf-b41f60a24add-delete_volume" released by "delete_volume" :: held 3.047s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:49 devstack sudo[110746]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-61eeb8ea-3c5f-4b49-8ad8-27d9267315f5 tempest-VolumeDependencyTests-776003185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9fcbeeef-c90a-4cb8-be48-7df380226ec6" returned: 0 in 0.900s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-61eeb8ea-3c5f-4b49-8ad8-27d9267315f5 tempest-VolumeDependencyTests-776003185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9fcbeeef-c90a-4cb8-be48-7df380226ec6 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:49 devstack sudo[110766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9fcbeeef-c90a-4cb8-be48-7df380226ec6 Aug 27 03:52:49 devstack sudo[110766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:49 devstack sudo[110766]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-61eeb8ea-3c5f-4b49-8ad8-27d9267315f5 tempest-VolumeDependencyTests-776003185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9fcbeeef-c90a-4cb8-be48-7df380226ec6" returned: 0 in 0.642s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-61eeb8ea-3c5f-4b49-8ad8-27d9267315f5 tempest-VolumeDependencyTests-776003185 None] Lock "cinder-quobyte-9fcbeeef-c90a-4cb8-be48-7df380226ec6" released by "delete_volume" :: held 1.656s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:50 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-61eeb8ea-3c5f-4b49-8ad8-27d9267315f5 tempest-VolumeDependencyTests-776003185 None] Created reservations ['5c359bd5-515f-4f6b-b38d-587d5d885c2f', '49decb04-83cd-49c6-9fec-885e1f3f2205', 'b40c8066-4aa8-4436-9b53-6cf344f15707', '8f319356-e6ff-42c5-8d00-8e3b67f34e7d'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:52:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-61eeb8ea-3c5f-4b49-8ad8-27d9267315f5 tempest-VolumeDependencyTests-776003185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-61eeb8ea-3c5f-4b49-8ad8-27d9267315f5 tempest-VolumeDependencyTests-776003185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-61eeb8ea-3c5f-4b49-8ad8-27d9267315f5 tempest-VolumeDependencyTests-776003185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:52:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-61eeb8ea-3c5f-4b49-8ad8-27d9267315f5 tempest-VolumeDependencyTests-776003185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:52:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-61eeb8ea-3c5f-4b49-8ad8-27d9267315f5 tempest-VolumeDependencyTests-776003185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-61eeb8ea-3c5f-4b49-8ad8-27d9267315f5 tempest-VolumeDependencyTests-776003185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:50 devstack sudo[110772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:52:50 devstack sudo[110772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:51 devstack sudo[110772]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-61eeb8ea-3c5f-4b49-8ad8-27d9267315f5 tempest-VolumeDependencyTests-776003185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.718s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:51 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-61eeb8ea-3c5f-4b49-8ad8-27d9267315f5 tempest-VolumeDependencyTests-776003185 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:52:51 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-61eeb8ea-3c5f-4b49-8ad8-27d9267315f5 tempest-VolumeDependencyTests-776003185 None] Deleted volume successfully. Aug 27 03:52:51 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:UPDATE=104,cinder:SELECT=84,cinder:INSERT=26,cinder:DELETE=6 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:52:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-61eeb8ea-3c5f-4b49-8ad8-27d9267315f5 tempest-VolumeDependencyTests-776003185 None] Lock "cinder-9fcbeeef-c90a-4cb8-be48-7df380226ec6-delete_volume" released by "delete_volume" :: held 2.975s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:51 devstack sudo[110668]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f3d07b33-3897-429c-a0c6-70dc209f5f92" returned: 0 in 6.391s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:51 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Image conversion details: src /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd, size 1024.00 MB, duration 6.39 sec, destination /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f3d07b33-3897-429c-a0c6-70dc209f5f92 {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:52:51 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Converted 1024.00 MB image at 160.20 MB/s Aug 27 03:52:51 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f3d07b33-3897-429c-a0c6-70dc209f5f92 is being set with open permissions: ugo+rw Aug 27 03:52:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f3d07b33-3897-429c-a0c6-70dc209f5f92 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:51 devstack sudo[110776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f3d07b33-3897-429c-a0c6-70dc209f5f92 Aug 27 03:52:51 devstack sudo[110776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:51 devstack sudo[110776]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f3d07b33-3897-429c-a0c6-70dc209f5f92" returned: 0 in 0.273s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Lock "cinder-quobyte-f3d07b33-3897-429c-a0c6-70dc209f5f92" released by "_copy_volume_from_snapshot" :: held 7.519s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Acquiring lock "cinder-quobyte-fc6890b9-e529-4c3e-9c6b-549efb7c475a" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Lock "cinder-quobyte-fc6890b9-e529-4c3e-9c6b-549efb7c475a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Deleting offline snapshot fc6890b9-e529-4c3e-9c6b-549efb7c475a of volume 4eb6a91d-67d8-4a4c-a439-18133454e4dd {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:52:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] snapshot_file for this snap is: volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.fc6890b9-e529-4c3e-9c6b-549efb7c475a {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:52:51 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff312cf-582f-4283-b5f8-d688bf3f3187]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.fc6890b9-e529-4c3e-9c6b-549efb7c475a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:51 devstack sudo[110779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.fc6890b9-e529-4c3e-9c6b-549efb7c475a Aug 27 03:52:51 devstack sudo[110779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:52 devstack sudo[110779]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.fc6890b9-e529-4c3e-9c6b-549efb7c475a" returned: 0 in 0.412s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:52:52 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3efcf7-8cf9-479b-bc65-ba5922a16c4a]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:52 devstack sudo[110785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd Aug 27 03:52:52 devstack sudo[110785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:52 devstack sudo[110785]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd" returned: 0 in 0.645s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.fc6890b9-e529-4c3e-9c6b-549efb7c475a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:52 devstack sudo[110792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.fc6890b9-e529-4c3e-9c6b-549efb7c475a Aug 27 03:52:52 devstack sudo[110792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:53 devstack sudo[110792]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.fc6890b9-e529-4c3e-9c6b-549efb7c475a" returned: 0 in 0.458s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.fc6890b9-e529-4c3e-9c6b-549efb7c475a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:53 devstack sudo[110798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.fc6890b9-e529-4c3e-9c6b-549efb7c475a Aug 27 03:52:53 devstack sudo[110798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:53 devstack sudo[110798]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd.fc6890b9-e529-4c3e-9c6b-549efb7c475a" returned: 0 in 0.261s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:53 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Lock "cinder-quobyte-fc6890b9-e529-4c3e-9c6b-549efb7c475a" released by "_delete_snapshot" :: held 1.911s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:53 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=87,cinder:INSERT=27,cinder:UPDATE=110,cinder:DELETE=10 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:52:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.083s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.382s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1338514187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf42cbd1-2faf-4f72-9efb-439cac4afd75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9585e1e5d341f196e16db82c94a707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:52:43Z,use_quota=True,user_id='dd6642fa8885421eac8ecd171e2e8847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:52:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Creating volume bf42cbd1-2faf-4f72-9efb-439cac4afd75 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:52:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:52:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:52:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:52:53 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:52:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bf42cbd1-2faf-4f72-9efb-439cac4afd75 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c58bb93-083a-4dc6-ae51-089f45087b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3d07b33-3897-429c-a0c6-70dc209f5f92', 'volume_size': 2, 'source_volid': '4eb6a91d-67d8-4a4c-a439-18133454e4dd', 'source_volstatus': 'available'}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:53 devstack sudo[110801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bf42cbd1-2faf-4f72-9efb-439cac4afd75 1073741824 Aug 27 03:52:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (797f8b18-7e42-4ab3-9049-baa781436760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:53 devstack sudo[110801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:53 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Volume volume-f3d07b33-3897-429c-a0c6-70dc209f5f92 (f3d07b33-3897-429c-a0c6-70dc209f5f92): created successfully Aug 27 03:52:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (797f8b18-7e42-4ab3-9049-baa781436760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Flow 'volume_create_manager' (4de8fdc4-47af-463d-a1d9-8b9e8d6f2c05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:52:53 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-85b33541-1563-4b0c-83a5-8771c460baf7 tempest-VolumesCloneTest-659664578 None] Created volume successfully. Aug 27 03:52:54 devstack sudo[110801]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bf42cbd1-2faf-4f72-9efb-439cac4afd75 1073741824" returned: 0 in 0.548s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bf42cbd1-2faf-4f72-9efb-439cac4afd75 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:54 devstack sudo[110806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bf42cbd1-2faf-4f72-9efb-439cac4afd75 Aug 27 03:52:54 devstack sudo[110806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:54 devstack sudo[110806]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bf42cbd1-2faf-4f72-9efb-439cac4afd75" returned: 0 in 0.258s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:54 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:52:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f89bdeb9-14c2-48bd-98dd-604d441e40de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf42cbd1-2faf-4f72-9efb-439cac4afd75', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e494b385-b823-4983-8db6-e94e8b7f928f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:54 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Volume volume-bf42cbd1-2faf-4f72-9efb-439cac4afd75 (bf42cbd1-2faf-4f72-9efb-439cac4afd75): created successfully Aug 27 03:52:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e494b385-b823-4983-8db6-e94e8b7f928f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Flow 'volume_create_manager' (f228988d-c8f5-40e3-afb7-64f8e83825b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:52:54 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-db8e8e85-872c-4781-b2b5-f60df52677a5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Created volume successfully. Aug 27 03:52:54 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a0f1397c-29cb-4876-9d33-79b6b7af25e2 tempest-VolumesCloneTest-659664578 None] Acquiring lock "cinder-f3d07b33-3897-429c-a0c6-70dc209f5f92-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:54 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a0f1397c-29cb-4876-9d33-79b6b7af25e2 tempest-VolumesCloneTest-659664578 None] Lock "cinder-f3d07b33-3897-429c-a0c6-70dc209f5f92-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:54 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a0f1397c-29cb-4876-9d33-79b6b7af25e2 tempest-VolumesCloneTest-659664578 None] Acquiring lock "cinder-quobyte-f3d07b33-3897-429c-a0c6-70dc209f5f92" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:54 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a0f1397c-29cb-4876-9d33-79b6b7af25e2 tempest-VolumesCloneTest-659664578 None] Lock "cinder-quobyte-f3d07b33-3897-429c-a0c6-70dc209f5f92" acquired by "delete_volume" :: waited 0.032s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:54 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9eb25e-7c07-4a5f-84c2-23aa271b58c5]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a0f1397c-29cb-4876-9d33-79b6b7af25e2 tempest-VolumesCloneTest-659664578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f3d07b33-3897-429c-a0c6-70dc209f5f92 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:54 devstack sudo[110809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f3d07b33-3897-429c-a0c6-70dc209f5f92 Aug 27 03:52:54 devstack sudo[110809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:55 devstack sudo[110809]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a0f1397c-29cb-4876-9d33-79b6b7af25e2 tempest-VolumesCloneTest-659664578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f3d07b33-3897-429c-a0c6-70dc209f5f92" returned: 0 in 0.421s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a0f1397c-29cb-4876-9d33-79b6b7af25e2 tempest-VolumesCloneTest-659664578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f3d07b33-3897-429c-a0c6-70dc209f5f92 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:55 devstack sudo[110814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f3d07b33-3897-429c-a0c6-70dc209f5f92 Aug 27 03:52:55 devstack sudo[110814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:55 devstack sudo[110814]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a0f1397c-29cb-4876-9d33-79b6b7af25e2 tempest-VolumesCloneTest-659664578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f3d07b33-3897-429c-a0c6-70dc209f5f92" returned: 0 in 0.341s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:55 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a0f1397c-29cb-4876-9d33-79b6b7af25e2 tempest-VolumesCloneTest-659664578 None] Lock "cinder-quobyte-f3d07b33-3897-429c-a0c6-70dc209f5f92" released by "delete_volume" :: held 0.815s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:55 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-a0f1397c-29cb-4876-9d33-79b6b7af25e2 tempest-VolumesCloneTest-659664578 None] Created reservations ['9bf1b39d-8ec9-441b-a322-4d54414167e1', 'b8083a8b-749b-4198-99f4-efacb48d6913', 'afa81482-c6fe-4aeb-887c-e0f624b15052', 'a980d093-01aa-4979-bf2e-f434a3420d65'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:52:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a0f1397c-29cb-4876-9d33-79b6b7af25e2 tempest-VolumesCloneTest-659664578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a0f1397c-29cb-4876-9d33-79b6b7af25e2 tempest-VolumesCloneTest-659664578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a0f1397c-29cb-4876-9d33-79b6b7af25e2 tempest-VolumesCloneTest-659664578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:52:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a0f1397c-29cb-4876-9d33-79b6b7af25e2 tempest-VolumesCloneTest-659664578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:52:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a0f1397c-29cb-4876-9d33-79b6b7af25e2 tempest-VolumesCloneTest-659664578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a0f1397c-29cb-4876-9d33-79b6b7af25e2 tempest-VolumesCloneTest-659664578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:55 devstack sudo[110820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:52:55 devstack sudo[110820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:56 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-32252008-ca3a-4e3f-8447-80ec8e18b1bf tempest-VolumesCloneTest-659664578 None] Acquiring lock "cinder-4eb6a91d-67d8-4a4c-a439-18133454e4dd-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:56 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-32252008-ca3a-4e3f-8447-80ec8e18b1bf tempest-VolumesCloneTest-659664578 None] Lock "cinder-4eb6a91d-67d8-4a4c-a439-18133454e4dd-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:56 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-32252008-ca3a-4e3f-8447-80ec8e18b1bf tempest-VolumesCloneTest-659664578 None] Acquiring lock "cinder-quobyte-4eb6a91d-67d8-4a4c-a439-18133454e4dd" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:52:56 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-32252008-ca3a-4e3f-8447-80ec8e18b1bf tempest-VolumesCloneTest-659664578 None] Lock "cinder-quobyte-4eb6a91d-67d8-4a4c-a439-18133454e4dd" acquired by "delete_volume" :: waited 0.029s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:52:56 devstack sudo[110820]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a0f1397c-29cb-4876-9d33-79b6b7af25e2 tempest-VolumesCloneTest-659664578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.565s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:56 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-a0f1397c-29cb-4876-9d33-79b6b7af25e2 tempest-VolumesCloneTest-659664578 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:52:56 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-a0f1397c-29cb-4876-9d33-79b6b7af25e2 tempest-VolumesCloneTest-659664578 None] Deleted volume successfully. Aug 27 03:52:56 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[327d3416-0a9e-46e6-8b18-3cd877f5bba9]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32252008-ca3a-4e3f-8447-80ec8e18b1bf tempest-VolumesCloneTest-659664578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:56 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a0f1397c-29cb-4876-9d33-79b6b7af25e2 tempest-VolumesCloneTest-659664578 None] Lock "cinder-f3d07b33-3897-429c-a0c6-70dc209f5f92-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:56 devstack sudo[110823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd Aug 27 03:52:56 devstack sudo[110823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-2d332d7f-e764-4d3c-bf64-0e2eb4498cea req-19babfe0-d30d-4152-84ed-6a18dce14ede tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-2d332d7f-e764-4d3c-bf64-0e2eb4498cea req-19babfe0-d30d-4152-84ed-6a18dce14ede tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-2d332d7f-e764-4d3c-bf64-0e2eb4498cea req-19babfe0-d30d-4152-84ed-6a18dce14ede tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-2d332d7f-e764-4d3c-bf64-0e2eb4498cea req-19babfe0-d30d-4152-84ed-6a18dce14ede tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac', 'name': 'volume-bf42cbd1-2faf-4f72-9efb-439cac4afd75', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43a430de-9da6-480b-8914-78c664282855', 'enforce_multipath': True} {{(pid=94328) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 27 03:52:56 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-2d332d7f-e764-4d3c-bf64-0e2eb4498cea req-19babfe0-d30d-4152-84ed-6a18dce14ede tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] attachment_update completed successfully. Aug 27 03:52:56 devstack sudo[110823]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32252008-ca3a-4e3f-8447-80ec8e18b1bf tempest-VolumesCloneTest-659664578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd" returned: 0 in 0.500s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32252008-ca3a-4e3f-8447-80ec8e18b1bf tempest-VolumesCloneTest-659664578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:56 devstack sudo[110836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd Aug 27 03:52:56 devstack sudo[110836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:57 devstack sudo[110836]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32252008-ca3a-4e3f-8447-80ec8e18b1bf tempest-VolumesCloneTest-659664578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4eb6a91d-67d8-4a4c-a439-18133454e4dd" returned: 0 in 0.352s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:57 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-32252008-ca3a-4e3f-8447-80ec8e18b1bf tempest-VolumesCloneTest-659664578 None] Lock "cinder-quobyte-4eb6a91d-67d8-4a4c-a439-18133454e4dd" released by "delete_volume" :: held 0.972s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:57 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-32252008-ca3a-4e3f-8447-80ec8e18b1bf tempest-VolumesCloneTest-659664578 None] Created reservations ['d8032e00-201a-4e99-b815-b928d1d5f128', '5c249fc7-a406-43cc-a8f6-a88a90733b74', '436be40c-0468-41e9-95d8-21a97527956d', 'd6889e69-557d-4a28-8ef9-35999965b10d'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:52:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-32252008-ca3a-4e3f-8447-80ec8e18b1bf tempest-VolumesCloneTest-659664578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:52:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-32252008-ca3a-4e3f-8447-80ec8e18b1bf tempest-VolumesCloneTest-659664578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:52:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-32252008-ca3a-4e3f-8447-80ec8e18b1bf tempest-VolumesCloneTest-659664578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:52:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-32252008-ca3a-4e3f-8447-80ec8e18b1bf tempest-VolumesCloneTest-659664578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:52:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-32252008-ca3a-4e3f-8447-80ec8e18b1bf tempest-VolumesCloneTest-659664578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:52:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32252008-ca3a-4e3f-8447-80ec8e18b1bf tempest-VolumesCloneTest-659664578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:57 devstack sudo[110844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:52:57 devstack sudo[110844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:57 devstack sudo[110844]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32252008-ca3a-4e3f-8447-80ec8e18b1bf tempest-VolumesCloneTest-659664578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.312s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:57 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-32252008-ca3a-4e3f-8447-80ec8e18b1bf tempest-VolumesCloneTest-659664578 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:52:57 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-32252008-ca3a-4e3f-8447-80ec8e18b1bf tempest-VolumesCloneTest-659664578 None] Deleted volume successfully. Aug 27 03:52:57 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-32252008-ca3a-4e3f-8447-80ec8e18b1bf tempest-VolumesCloneTest-659664578 None] Lock "cinder-4eb6a91d-67d8-4a4c-a439-18133454e4dd-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:52:58 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:52:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Flow 'volume_create_manager' (ad4ef8c5-f481-41f2-bed5-b026409383a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:52:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a8ef42a-f785-49ad-8726-6215b4344a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a8ef42a-f785-49ad-8726-6215b4344a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7182338b-317f-4d55-9100-7f6b2f22175d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38de7823a5b64a14be07535cc325d358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:52:58Z,use_quota=True,user_id='3528e7811c9745d089f7425d86504630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52f6fe9-b86b-47db-8fea-0176680b42b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52f6fe9-b86b-47db-8fea-0176680b42b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:58 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28401c41-a116-4698-823d-cbd60226679c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:58 devstack cinder-volume[94328]: DEBUG cinder.image.glance [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Creating Keystone auth plugin from conf {{(pid=94328) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 27 03:52:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28401c41-a116-4698-823d-cbd60226679c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7182338b-317f-4d55-9100-7f6b2f22175d', 'volume_name': 'volume-7182338b-317f-4d55-9100-7f6b2f22175d', 'volume_size': 1, 'image_id': 'c5859d07-af3e-40ba-b959-f7cac56481e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5859d07-af3e-40ba-b959-f7cac56481e8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'aec61742debab65254bf3aae9b19b32f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38de7823a5b64a14be07535cc325d358', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1365c74c5353411c616e41be6594618f22c429fec360113ae28f5c8dc968883c6b8e93239f46759e5b28ce405ca4929bbb181ec76f4b5a1e6d9c8d1dd97f8c98', 'id': 'c5859d07-af3e-40ba-b959-f7cac56481e8', 'created_at': datetime.datetime(2026, 8, 27, 1, 52, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 52, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5859d07-af3e-40ba-b959-f7cac56481e8/file', 'properties': {}}, 'image_service': }' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e48741a7-192f-4835-baad-a022666f2b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e48741a7-192f-4835-baad-a022666f2b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:52:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d21f93-2f31-478b-bf16-0e471d928ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:52:59 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Volume 7182338b-317f-4d55-9100-7f6b2f22175d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7182338b-317f-4d55-9100-7f6b2f22175d', 'volume_size': 1, 'image_id': 'c5859d07-af3e-40ba-b959-f7cac56481e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5859d07-af3e-40ba-b959-f7cac56481e8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'aec61742debab65254bf3aae9b19b32f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38de7823a5b64a14be07535cc325d358', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1365c74c5353411c616e41be6594618f22c429fec360113ae28f5c8dc968883c6b8e93239f46759e5b28ce405ca4929bbb181ec76f4b5a1e6d9c8d1dd97f8c98', 'id': 'c5859d07-af3e-40ba-b959-f7cac56481e8', 'created_at': datetime.datetime(2026, 8, 27, 1, 52, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 52, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5859d07-af3e-40ba-b959-f7cac56481e8/file', 'properties': {}}, 'image_service': } Aug 27 03:52:59 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Trying to clone 7182338b-317f-4d55-9100-7f6b2f22175d from image c5859d07-af3e-40ba-b959-f7cac56481e8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c5859d07-af3e-40ba-b959-f7cac56481e8', 'metadata': {}}]). {{(pid=94328) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 27 03:52:59 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 27 03:52:59 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Image download 0.00 MB at 0.00 MB/s Aug 27 03:52:59 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[0006fdac-3d76-4e9f-a4bc-5569a8a02665]: (4, 'raw') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:52:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:52:59 devstack sudo[110847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD Aug 27 03:52:59 devstack sudo[110847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:52:59 devstack sudo[110847]: pam_unix(sudo:session): session closed for user root Aug 27 03:52:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD" returned: 0 in 0.502s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:52:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:00 devstack sudo[110851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD Aug 27 03:53:00 devstack sudo[110851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:00 devstack sudo[110851]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD" returned: 1 in 0.411s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD' failed. Not Retrying. {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 27 03:53:00 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Temporary image c5859d07-af3e-40ba-b959-f7cac56481e8 is fetched for user 3528e7811c9745d089f7425d86504630. {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 27 03:53:00 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[4801937b-a2be-4671-91e6-72f4f736c55c]: (4, 'raw') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:53:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:00 devstack sudo[110860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD Aug 27 03:53:00 devstack sudo[110860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:00 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-22402b60-9fff-4b30-a5a0-960eaeb74023 req-16b11ab0-fde3-4630-8409-73339ae9345f tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Terminate volume connection completed successfully. Aug 27 03:53:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-22402b60-9fff-4b30-a5a0-960eaeb74023 req-16b11ab0-fde3-4630-8409-73339ae9345f tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Deleting attachment 43a430de-9da6-480b-8914-78c664282855. {{(pid=94328) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 27 03:53:00 devstack sudo[110860]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD" returned: 0 in 0.467s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:00 devstack sudo[110866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD Aug 27 03:53:00 devstack sudo[110866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:01 devstack sudo[110866]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD" returned: 1 in 0.395s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD' failed. Not Retrying. {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 27 03:53:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7182338b-317f-4d55-9100-7f6b2f22175d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38de7823a5b64a14be07535cc325d358',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:52:58Z,use_quota=True,user_id='3528e7811c9745d089f7425d86504630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:53:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Creating volume 7182338b-317f-4d55-9100-7f6b2f22175d {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:53:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:53:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:53:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:53:01 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:53:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7182338b-317f-4d55-9100-7f6b2f22175d 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:01 devstack sudo[110871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7182338b-317f-4d55-9100-7f6b2f22175d 1073741824 Aug 27 03:53:01 devstack sudo[110871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:01 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2c6e49c1-de39-44a2-a411-7ebc979079e5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Acquiring lock "cinder-bf42cbd1-2faf-4f72-9efb-439cac4afd75-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:53:01 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2c6e49c1-de39-44a2-a411-7ebc979079e5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Lock "cinder-bf42cbd1-2faf-4f72-9efb-439cac4afd75-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:53:01 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2c6e49c1-de39-44a2-a411-7ebc979079e5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Acquiring lock "cinder-quobyte-bf42cbd1-2faf-4f72-9efb-439cac4afd75" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:53:01 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2c6e49c1-de39-44a2-a411-7ebc979079e5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Lock "cinder-quobyte-bf42cbd1-2faf-4f72-9efb-439cac4afd75" acquired by "delete_volume" :: waited 0.024s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:53:01 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eaa0be7-21ab-4c06-adfe-a3856acb3990]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:53:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2c6e49c1-de39-44a2-a411-7ebc979079e5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bf42cbd1-2faf-4f72-9efb-439cac4afd75 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:01 devstack sudo[110873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bf42cbd1-2faf-4f72-9efb-439cac4afd75 Aug 27 03:53:01 devstack sudo[110873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:01 devstack sudo[110871]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7182338b-317f-4d55-9100-7f6b2f22175d 1073741824" returned: 0 in 0.655s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7182338b-317f-4d55-9100-7f6b2f22175d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:02 devstack sudo[110882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7182338b-317f-4d55-9100-7f6b2f22175d Aug 27 03:53:02 devstack sudo[110882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:02 devstack sudo[110873]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2c6e49c1-de39-44a2-a411-7ebc979079e5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bf42cbd1-2faf-4f72-9efb-439cac4afd75" returned: 0 in 0.567s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2c6e49c1-de39-44a2-a411-7ebc979079e5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bf42cbd1-2faf-4f72-9efb-439cac4afd75 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:02 devstack sudo[110885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bf42cbd1-2faf-4f72-9efb-439cac4afd75 Aug 27 03:53:02 devstack sudo[110885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:02 devstack sudo[110882]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7182338b-317f-4d55-9100-7f6b2f22175d" returned: 0 in 0.330s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:02 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:53:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:02 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Attempting download of c5859d07-af3e-40ba-b959-f7cac56481e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/c5859d07-af3e-40ba-b959-f7cac56481e8', 'metadata': {}}])) to volume 7182338b-317f-4d55-9100-7f6b2f22175d. {{(pid=94328) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 27 03:53:02 devstack sudo[110885]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2c6e49c1-de39-44a2-a411-7ebc979079e5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-bf42cbd1-2faf-4f72-9efb-439cac4afd75" returned: 0 in 0.290s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2c6e49c1-de39-44a2-a411-7ebc979079e5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Lock "cinder-quobyte-bf42cbd1-2faf-4f72-9efb-439cac4afd75" released by "delete_volume" :: held 0.937s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:53:02 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[1175271b-e83d-4ed3-a622-2883d6523a75]: (4, 'raw') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:53:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5859d07-af3e-40ba-b959-f7cac56481e8_rmfjb8g3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:02 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-2c6e49c1-de39-44a2-a411-7ebc979079e5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Created reservations ['d3bf3baa-fd70-4d75-a039-63ce8bc35be0', '13af8467-9c45-40c5-8629-08a903ead76a', '6caae4ae-6319-4ff5-b805-1ab6954d224e', '81365c30-c8dc-41c7-a224-35c70683b97d'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:53:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2c6e49c1-de39-44a2-a411-7ebc979079e5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2c6e49c1-de39-44a2-a411-7ebc979079e5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:02 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2c6e49c1-de39-44a2-a411-7ebc979079e5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:53:02 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2c6e49c1-de39-44a2-a411-7ebc979079e5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:53:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2c6e49c1-de39-44a2-a411-7ebc979079e5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2c6e49c1-de39-44a2-a411-7ebc979079e5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:02 devstack sudo[110890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:53:02 devstack sudo[110890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:02 devstack sudo[110889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5859d07-af3e-40ba-b959-f7cac56481e8_rmfjb8g3 Aug 27 03:53:02 devstack sudo[110889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:02 devstack sudo[110890]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2c6e49c1-de39-44a2-a411-7ebc979079e5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.338s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:02 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-2c6e49c1-de39-44a2-a411-7ebc979079e5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:53:02 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-2c6e49c1-de39-44a2-a411-7ebc979079e5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Deleted volume successfully. Aug 27 03:53:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2c6e49c1-de39-44a2-a411-7ebc979079e5 tempest-TestServerVolumeAttachScenarioOldVersion-2039751861 None] Lock "cinder-bf42cbd1-2faf-4f72-9efb-439cac4afd75-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:53:03 devstack sudo[110889]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5859d07-af3e-40ba-b959-f7cac56481e8_rmfjb8g3" returned: 0 in 0.595s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5859d07-af3e-40ba-b959-f7cac56481e8_rmfjb8g3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:03 devstack sudo[110897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5859d07-af3e-40ba-b959-f7cac56481e8_rmfjb8g3 Aug 27 03:53:03 devstack sudo[110897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:03 devstack sudo[110897]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5859d07-af3e-40ba-b959-f7cac56481e8_rmfjb8g3" returned: 1 in 0.370s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5859d07-af3e-40ba-b959-f7cac56481e8_rmfjb8g3' failed. Not Retrying. {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 27 03:53:03 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9218ccc-dcaf-4671-821c-c9ac84130adb]: (4, 'raw') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:53:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:03 devstack sudo[110904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD Aug 27 03:53:03 devstack sudo[110904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:03 devstack sudo[110904]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:03 devstack sudo[110910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD Aug 27 03:53:03 devstack sudo[110910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:04 devstack sudo[110910]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD' failed. Not Retrying. {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 27 03:53:04 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] c5859d07-af3e-40ba-b959-f7cac56481e8 was raw, converting to qcow2 {{(pid=94328) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 27 03:53:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7182338b-317f-4d55-9100-7f6b2f22175d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:04 devstack sudo[110923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7182338b-317f-4d55-9100-7f6b2f22175d Aug 27 03:53:04 devstack sudo[110923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:04 devstack sudo[110923]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7182338b-317f-4d55-9100-7f6b2f22175d" returned: 0 in 0.740s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:04 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c5859d07-af3e-40ba-b959-f7cac56481e8_8t3kguledevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7182338b-317f-4d55-9100-7f6b2f22175d {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:53:04 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Converted 0.00 MB image at 0.00 MB/s Aug 27 03:53:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7182338b-317f-4d55-9100-7f6b2f22175d 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:04 devstack sudo[110944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7182338b-317f-4d55-9100-7f6b2f22175d 1G Aug 27 03:53:04 devstack sudo[110944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Flow 'volume_create_manager' (9a5ce3e5-ce6b-49dc-85ae-cb35b37ea2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (746d9046-91f6-4f1e-983b-327de271a6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (746d9046-91f6-4f1e-983b-327de271a6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-791375128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9af44fa-96ca-4b9c-a82c-30cc6c0a872d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9ae9d6649aec4cc1b73d3039a7e02815',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:53:05Z,use_quota=True,user_id='828a8c14c7144fb691175060430d6a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd92a1d7-0499-45fd-9958-f4006e2d6b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd92a1d7-0499-45fd-9958-f4006e2d6b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae85263d-420f-4727-bafa-25cd4f07c941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae85263d-420f-4727-bafa-25cd4f07c941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9af44fa-96ca-4b9c-a82c-30cc6c0a872d', 'volume_name': 'volume-b9af44fa-96ca-4b9c-a82c-30cc6c0a872d', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d011884-b6de-4f9c-b651-39fe125279a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d011884-b6de-4f9c-b651-39fe125279a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9318ca-0017-4fa8-863d-10bd4ab710c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:05 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Volume b9af44fa-96ca-4b9c-a82c-30cc6c0a872d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9af44fa-96ca-4b9c-a82c-30cc6c0a872d', 'volume_size': 1} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-791375128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9af44fa-96ca-4b9c-a82c-30cc6c0a872d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9ae9d6649aec4cc1b73d3039a7e02815',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:53:05Z,use_quota=True,user_id='828a8c14c7144fb691175060430d6a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Creating volume b9af44fa-96ca-4b9c-a82c-30cc6c0a872d {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:53:05 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9af44fa-96ca-4b9c-a82c-30cc6c0a872d 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:05 devstack sudo[110946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9af44fa-96ca-4b9c-a82c-30cc6c0a872d 1073741824 Aug 27 03:53:05 devstack sudo[110946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:05 devstack sudo[110944]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7182338b-317f-4d55-9100-7f6b2f22175d 1G" returned: 0 in 0.474s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Downloaded image c5859d07-af3e-40ba-b959-f7cac56481e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/c5859d07-af3e-40ba-b959-f7cac56481e8', 'metadata': {}}])) to volume 7182338b-317f-4d55-9100-7f6b2f22175d successfully. {{(pid=94328) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Temporary image c5859d07-af3e-40ba-b959-f7cac56481e8 for user 3528e7811c9745d089f7425d86504630 is deleted. {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Marking volume 7182338b-317f-4d55-9100-7f6b2f22175d as bootable. {{(pid=94328) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Copying metadata from image c5859d07-af3e-40ba-b959-f7cac56481e8 to 7182338b-317f-4d55-9100-7f6b2f22175d. {{(pid=94328) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Creating volume glance metadata for volume 7182338b-317f-4d55-9100-7f6b2f22175d backed by image c5859d07-af3e-40ba-b959-f7cac56481e8 with: {'image_id': 'c5859d07-af3e-40ba-b959-f7cac56481e8', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'aec61742debab65254bf3aae9b19b32f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94328) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d21f93-2f31-478b-bf16-0e471d928ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7182338b-317f-4d55-9100-7f6b2f22175d', 'volume_size': 1, 'image_id': 'c5859d07-af3e-40ba-b959-f7cac56481e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5859d07-af3e-40ba-b959-f7cac56481e8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'aec61742debab65254bf3aae9b19b32f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38de7823a5b64a14be07535cc325d358', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1365c74c5353411c616e41be6594618f22c429fec360113ae28f5c8dc968883c6b8e93239f46759e5b28ce405ca4929bbb181ec76f4b5a1e6d9c8d1dd97f8c98', 'id': 'c5859d07-af3e-40ba-b959-f7cac56481e8', 'created_at': datetime.datetime(2026, 8, 27, 1, 52, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 52, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5859d07-af3e-40ba-b959-f7cac56481e8/file', 'properties': {}}, 'image_service': }' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b50268-74b9-4b2a-bb8f-1db7380f5b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:05 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Volume volume-7182338b-317f-4d55-9100-7f6b2f22175d (7182338b-317f-4d55-9100-7f6b2f22175d): created successfully Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b50268-74b9-4b2a-bb8f-1db7380f5b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Flow 'volume_create_manager' (ad4ef8c5-f481-41f2-bed5-b026409383a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:53:05 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-805941a2-d69e-4960-b1b2-36f59c6a2b16 tempest-VolumeImageDependencyTests-1505858738 None] Created volume successfully. Aug 27 03:53:05 devstack sudo[110946]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9af44fa-96ca-4b9c-a82c-30cc6c0a872d 1073741824" returned: 0 in 0.552s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9af44fa-96ca-4b9c-a82c-30cc6c0a872d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:05 devstack sudo[110958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9af44fa-96ca-4b9c-a82c-30cc6c0a872d Aug 27 03:53:05 devstack sudo[110958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:06 devstack sudo[110958]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9af44fa-96ca-4b9c-a82c-30cc6c0a872d" returned: 0 in 0.320s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:06 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:53:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9318ca-0017-4fa8-863d-10bd4ab710c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9af44fa-96ca-4b9c-a82c-30cc6c0a872d', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c47ebe5-5f48-4768-a398-5362d87961b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:06 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Volume volume-b9af44fa-96ca-4b9c-a82c-30cc6c0a872d (b9af44fa-96ca-4b9c-a82c-30cc6c0a872d): created successfully Aug 27 03:53:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c47ebe5-5f48-4768-a398-5362d87961b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Flow 'volume_create_manager' (9a5ce3e5-ce6b-49dc-85ae-cb35b37ea2f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:53:06 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-a261da7a-858b-4fc9-bba2-3dbbe9c1cfac tempest-VolumesListTestJSON-65305252 None] Created volume successfully. Aug 27 03:53:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b443d20e-4a95-4e4e-a4f7-b773b22453bc tempest-VolumeImageDependencyTests-1505858738 None] Acquiring lock "cinder-7182338b-317f-4d55-9100-7f6b2f22175d-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:53:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b443d20e-4a95-4e4e-a4f7-b773b22453bc tempest-VolumeImageDependencyTests-1505858738 None] Lock "cinder-7182338b-317f-4d55-9100-7f6b2f22175d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:53:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b443d20e-4a95-4e4e-a4f7-b773b22453bc tempest-VolumeImageDependencyTests-1505858738 None] Acquiring lock "cinder-quobyte-7182338b-317f-4d55-9100-7f6b2f22175d" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:53:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b443d20e-4a95-4e4e-a4f7-b773b22453bc tempest-VolumeImageDependencyTests-1505858738 None] Lock "cinder-quobyte-7182338b-317f-4d55-9100-7f6b2f22175d" acquired by "delete_volume" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:53:06 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca948054-ea07-4a63-869e-0a21289b215a]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:53:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b443d20e-4a95-4e4e-a4f7-b773b22453bc tempest-VolumeImageDependencyTests-1505858738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7182338b-317f-4d55-9100-7f6b2f22175d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:06 devstack sudo[110962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7182338b-317f-4d55-9100-7f6b2f22175d Aug 27 03:53:06 devstack sudo[110962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:06 devstack sudo[110962]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b443d20e-4a95-4e4e-a4f7-b773b22453bc tempest-VolumeImageDependencyTests-1505858738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7182338b-317f-4d55-9100-7f6b2f22175d" returned: 0 in 0.371s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b443d20e-4a95-4e4e-a4f7-b773b22453bc tempest-VolumeImageDependencyTests-1505858738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7182338b-317f-4d55-9100-7f6b2f22175d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:06 devstack sudo[110967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7182338b-317f-4d55-9100-7f6b2f22175d Aug 27 03:53:06 devstack sudo[110967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:06 devstack sudo[110967]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b443d20e-4a95-4e4e-a4f7-b773b22453bc tempest-VolumeImageDependencyTests-1505858738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7182338b-317f-4d55-9100-7f6b2f22175d" returned: 0 in 0.266s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b443d20e-4a95-4e4e-a4f7-b773b22453bc tempest-VolumeImageDependencyTests-1505858738 None] Lock "cinder-quobyte-7182338b-317f-4d55-9100-7f6b2f22175d" released by "delete_volume" :: held 0.681s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-b443d20e-4a95-4e4e-a4f7-b773b22453bc tempest-VolumeImageDependencyTests-1505858738 None] Created reservations ['68ca9096-e6c4-4243-ba90-e488f21304e6', '9d10ddfa-84c5-4ddd-90f8-41726b37e327', '1d1d6232-6932-4d46-8db7-63f2c90166d8', 'bc832f61-703e-48b4-858d-7b3b0790f4ef'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b443d20e-4a95-4e4e-a4f7-b773b22453bc tempest-VolumeImageDependencyTests-1505858738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b443d20e-4a95-4e4e-a4f7-b773b22453bc tempest-VolumeImageDependencyTests-1505858738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b443d20e-4a95-4e4e-a4f7-b773b22453bc tempest-VolumeImageDependencyTests-1505858738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b443d20e-4a95-4e4e-a4f7-b773b22453bc tempest-VolumeImageDependencyTests-1505858738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b443d20e-4a95-4e4e-a4f7-b773b22453bc tempest-VolumeImageDependencyTests-1505858738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b443d20e-4a95-4e4e-a4f7-b773b22453bc tempest-VolumeImageDependencyTests-1505858738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:07 devstack sudo[110970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:53:07 devstack sudo[110970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:07 devstack sudo[110970]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b443d20e-4a95-4e4e-a4f7-b773b22453bc tempest-VolumeImageDependencyTests-1505858738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.259s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-b443d20e-4a95-4e4e-a4f7-b773b22453bc tempest-VolumeImageDependencyTests-1505858738 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:53:07 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-b443d20e-4a95-4e4e-a4f7-b773b22453bc tempest-VolumeImageDependencyTests-1505858738 None] Deleted volume successfully. Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b443d20e-4a95-4e4e-a4f7-b773b22453bc tempest-VolumeImageDependencyTests-1505858738 None] Lock "cinder-7182338b-317f-4d55-9100-7f6b2f22175d-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Flow 'volume_create_manager' (1b1d4f81-ef0b-40bf-8ffc-3486b28662a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d249138-7433-42cf-9ca7-da20e4e040a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d249138-7433-42cf-9ca7-da20e4e040a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1651334896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e381650d-b184-410a-9ac1-c35cf84025df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9ae9d6649aec4cc1b73d3039a7e02815',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:53:08Z,use_quota=True,user_id='828a8c14c7144fb691175060430d6a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47351a76-5b43-4997-9f97-5688dfdb306d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47351a76-5b43-4997-9f97-5688dfdb306d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6cddff9-4b02-491b-9a9b-3ccd6c2faafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6cddff9-4b02-491b-9a9b-3ccd6c2faafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e381650d-b184-410a-9ac1-c35cf84025df', 'volume_name': 'volume-e381650d-b184-410a-9ac1-c35cf84025df', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31e890fd-ce4d-497a-9667-3bf01aeca3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31e890fd-ce4d-497a-9667-3bf01aeca3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddeb9fee-3c40-403e-8335-566ed73380bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:07 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Volume e381650d-b184-410a-9ac1-c35cf84025df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e381650d-b184-410a-9ac1-c35cf84025df', 'volume_size': 1} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1651334896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e381650d-b184-410a-9ac1-c35cf84025df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9ae9d6649aec4cc1b73d3039a7e02815',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:53:08Z,use_quota=True,user_id='828a8c14c7144fb691175060430d6a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Creating volume e381650d-b184-410a-9ac1-c35cf84025df {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:53:07 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:53:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e381650d-b184-410a-9ac1-c35cf84025df 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:07 devstack sudo[110973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e381650d-b184-410a-9ac1-c35cf84025df 1073741824 Aug 27 03:53:07 devstack sudo[110973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:08 devstack sudo[110973]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e381650d-b184-410a-9ac1-c35cf84025df 1073741824" returned: 0 in 0.522s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e381650d-b184-410a-9ac1-c35cf84025df {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:08 devstack sudo[110979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e381650d-b184-410a-9ac1-c35cf84025df Aug 27 03:53:08 devstack sudo[110979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:08 devstack sudo[110979]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e381650d-b184-410a-9ac1-c35cf84025df" returned: 0 in 0.289s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:08 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:53:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddeb9fee-3c40-403e-8335-566ed73380bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e381650d-b184-410a-9ac1-c35cf84025df', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77f2d86-9333-4490-89e0-f667cd418e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:08 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Volume volume-e381650d-b184-410a-9ac1-c35cf84025df (e381650d-b184-410a-9ac1-c35cf84025df): created successfully Aug 27 03:53:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77f2d86-9333-4490-89e0-f667cd418e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Flow 'volume_create_manager' (1b1d4f81-ef0b-40bf-8ffc-3486b28662a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:53:08 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-b062b7ad-a915-4e28-af1a-b3feb99e6790 tempest-VolumesListTestJSON-65305252 None] Created volume successfully. Aug 27 03:53:10 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:53:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Flow 'volume_create_manager' (d8d12e72-1724-405e-8272-1dfd20d72814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:53:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7617722d-c276-4bc2-9df1-6c4f0f941af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7617722d-c276-4bc2-9df1-6c4f0f941af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-552499772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6645b809-cd0d-45ed-955b-24c8b1708af3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9ae9d6649aec4cc1b73d3039a7e02815',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:53:11Z,use_quota=True,user_id='828a8c14c7144fb691175060430d6a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2947fc62-a26e-47b8-bf6b-d9482b610c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2947fc62-a26e-47b8-bf6b-d9482b610c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eda9a72-2100-472b-ab9d-e9d5e6ef5df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eda9a72-2100-472b-ab9d-e9d5e6ef5df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6645b809-cd0d-45ed-955b-24c8b1708af3', 'volume_name': 'volume-6645b809-cd0d-45ed-955b-24c8b1708af3', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3079324-a8a2-45ba-b8ee-18e55232f615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3079324-a8a2-45ba-b8ee-18e55232f615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e49af30f-c89d-4155-af9f-12dd76978ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:10 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Volume 6645b809-cd0d-45ed-955b-24c8b1708af3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6645b809-cd0d-45ed-955b-24c8b1708af3', 'volume_size': 1} Aug 27 03:53:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-552499772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6645b809-cd0d-45ed-955b-24c8b1708af3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9ae9d6649aec4cc1b73d3039a7e02815',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:53:11Z,use_quota=True,user_id='828a8c14c7144fb691175060430d6a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:53:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Creating volume 6645b809-cd0d-45ed-955b-24c8b1708af3 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:53:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:53:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:53:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:53:10 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:53:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6645b809-cd0d-45ed-955b-24c8b1708af3 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:10 devstack sudo[110983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6645b809-cd0d-45ed-955b-24c8b1708af3 1073741824 Aug 27 03:53:10 devstack sudo[110983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:11 devstack sudo[110983]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6645b809-cd0d-45ed-955b-24c8b1708af3 1073741824" returned: 0 in 0.642s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6645b809-cd0d-45ed-955b-24c8b1708af3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:11 devstack sudo[110989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6645b809-cd0d-45ed-955b-24c8b1708af3 Aug 27 03:53:11 devstack sudo[110989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Flow 'volume_create_manager' (71fde44d-c16b-4584-9d48-380a16b49942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4bcde2d-5f8d-48ef-8cb1-920e3f60bb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4bcde2d-5f8d-48ef-8cb1-920e3f60bb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4bd483a-e75a-4ddb-a73b-a6c15448ac40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e123771ec14ee092b863bbbf0fa687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:53:12Z,use_quota=True,user_id='3edee436546743faa0645d6af8427c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33827013-bf9e-4cad-8d71-47f8444e1a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33827013-bf9e-4cad-8d71-47f8444e1a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e127b3-33df-48ee-98bc-7e8830425f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e127b3-33df-48ee-98bc-7e8830425f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4bd483a-e75a-4ddb-a73b-a6c15448ac40', 'volume_name': 'volume-b4bd483a-e75a-4ddb-a73b-a6c15448ac40', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b715940-f104-4c64-a159-8759bf4ad178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b715940-f104-4c64-a159-8759bf4ad178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357503ae-c7fd-4862-9104-538f2ea62ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:11 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Volume b4bd483a-e75a-4ddb-a73b-a6c15448ac40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4bd483a-e75a-4ddb-a73b-a6c15448ac40', 'volume_size': 1} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:11 devstack sudo[110989]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6645b809-cd0d-45ed-955b-24c8b1708af3" returned: 0 in 0.303s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.160s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4bd483a-e75a-4ddb-a73b-a6c15448ac40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e123771ec14ee092b863bbbf0fa687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:53:12Z,use_quota=True,user_id='3edee436546743faa0645d6af8427c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Creating volume b4bd483a-e75a-4ddb-a73b-a6c15448ac40 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:53:11 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b4bd483a-e75a-4ddb-a73b-a6c15448ac40 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:11 devstack sudo[110992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b4bd483a-e75a-4ddb-a73b-a6c15448ac40 1073741824 Aug 27 03:53:11 devstack sudo[110992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e49af30f-c89d-4155-af9f-12dd76978ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6645b809-cd0d-45ed-955b-24c8b1708af3', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41c264e7-3614-4874-b233-e269b63dca2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:11 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Volume volume-6645b809-cd0d-45ed-955b-24c8b1708af3 (6645b809-cd0d-45ed-955b-24c8b1708af3): created successfully Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41c264e7-3614-4874-b233-e269b63dca2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Flow 'volume_create_manager' (d8d12e72-1724-405e-8272-1dfd20d72814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:53:12 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-ec972822-73b2-419e-846d-04f0c013eaf7 tempest-VolumesListTestJSON-65305252 None] Created volume successfully. Aug 27 03:53:12 devstack sudo[110992]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b4bd483a-e75a-4ddb-a73b-a6c15448ac40 1073741824" returned: 0 in 0.442s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b4bd483a-e75a-4ddb-a73b-a6c15448ac40 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:12 devstack sudo[110997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b4bd483a-e75a-4ddb-a73b-a6c15448ac40 Aug 27 03:53:12 devstack sudo[110997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:12 devstack sudo[110997]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b4bd483a-e75a-4ddb-a73b-a6c15448ac40" returned: 0 in 0.240s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:53:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357503ae-c7fd-4862-9104-538f2ea62ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4bd483a-e75a-4ddb-a73b-a6c15448ac40', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f05b6d6-54d3-4deb-9150-c71552a59160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:12 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Volume volume-b4bd483a-e75a-4ddb-a73b-a6c15448ac40 (b4bd483a-e75a-4ddb-a73b-a6c15448ac40): created successfully Aug 27 03:53:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f05b6d6-54d3-4deb-9150-c71552a59160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Flow 'volume_create_manager' (71fde44d-c16b-4584-9d48-380a16b49942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:53:12 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-4c6e7486-3d62-4815-a713-aec7798ad2bd tempest-CinderUnicodeTest-881212963 None] Created volume successfully. Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Flow 'volume_create_manager' (f033ab01-0c88-479d-b60e-8b622693e042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0505330c-4891-46fc-999a-a473f70ef28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0505330c-4891-46fc-999a-a473f70ef28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:53:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-979842989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b41039-4e4f-48f0-9098-28c2291d8495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e123771ec14ee092b863bbbf0fa687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:53:15Z,use_quota=True,user_id='3edee436546743faa0645d6af8427c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e93ac4d-5fa0-48bb-ab35-20578180bb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e93ac4d-5fa0-48bb-ab35-20578180bb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7898bfe5-12c1-4326-8302-9e4a07c0eefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7898bfe5-12c1-4326-8302-9e4a07c0eefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8b41039-4e4f-48f0-9098-28c2291d8495', 'volume_name': 'volume-a8b41039-4e4f-48f0-9098-28c2291d8495', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0783277a-0f66-4994-aaa2-dd11d87da6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0783277a-0f66-4994-aaa2-dd11d87da6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f69dfb-1a77-45b0-9371-1f1538441a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:14 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Volume a8b41039-4e4f-48f0-9098-28c2291d8495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8b41039-4e4f-48f0-9098-28c2291d8495', 'volume_size': 1} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:53:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-979842989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b41039-4e4f-48f0-9098-28c2291d8495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e123771ec14ee092b863bbbf0fa687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:53:15Z,use_quota=True,user_id='3edee436546743faa0645d6af8427c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Creating volume a8b41039-4e4f-48f0-9098-28c2291d8495 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:53:14 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:14 devstack sudo[111007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495 1073741824 Aug 27 03:53:14 devstack sudo[111007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:14 devstack sudo[111009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:53:14 devstack sudo[111009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:15 devstack sudo[111009]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.411s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:53:15 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager._thread_info {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:53:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread count: 28 {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 03:53:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread info: [<_MainThread(MainThread, started 134250325188736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 03:53:15 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-bbe0b0c2-65f6-4f11-878d-1a79c15259f8 tempest-VolumesListTestJSON-65305252 None] Acquiring lock "cinder-6645b809-cd0d-45ed-955b-24c8b1708af3-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:53:15 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-bbe0b0c2-65f6-4f11-878d-1a79c15259f8 tempest-VolumesListTestJSON-65305252 None] Lock "cinder-6645b809-cd0d-45ed-955b-24c8b1708af3-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:53:15 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-bbe0b0c2-65f6-4f11-878d-1a79c15259f8 tempest-VolumesListTestJSON-65305252 None] Acquiring lock "cinder-quobyte-6645b809-cd0d-45ed-955b-24c8b1708af3" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:53:15 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-bbe0b0c2-65f6-4f11-878d-1a79c15259f8 tempest-VolumesListTestJSON-65305252 None] Lock "cinder-quobyte-6645b809-cd0d-45ed-955b-24c8b1708af3" acquired by "delete_volume" :: waited 0.033s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:53:15 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea543f08-2607-425b-b69c-ebfd051aa9fb]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:53:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-bbe0b0c2-65f6-4f11-878d-1a79c15259f8 tempest-VolumesListTestJSON-65305252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6645b809-cd0d-45ed-955b-24c8b1708af3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:15 devstack sudo[111007]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495 1073741824" returned: 0 in 0.924s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:15 devstack sudo[111049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6645b809-cd0d-45ed-955b-24c8b1708af3 Aug 27 03:53:15 devstack sudo[111049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:15 devstack sudo[111051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495 Aug 27 03:53:15 devstack sudo[111051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:16 devstack sudo[111051]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495" returned: 0 in 0.332s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:16 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:53:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f69dfb-1a77-45b0-9371-1f1538441a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8b41039-4e4f-48f0-9098-28c2291d8495', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85fbe8e2-073b-4bdb-a149-17f7391e8bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:16 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Volume volume-a8b41039-4e4f-48f0-9098-28c2291d8495 (a8b41039-4e4f-48f0-9098-28c2291d8495): created successfully Aug 27 03:53:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85fbe8e2-073b-4bdb-a149-17f7391e8bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:16 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Flow 'volume_create_manager' (f033ab01-0c88-479d-b60e-8b622693e042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:53:16 devstack sudo[111049]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-bbe0b0c2-65f6-4f11-878d-1a79c15259f8 tempest-VolumesListTestJSON-65305252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6645b809-cd0d-45ed-955b-24c8b1708af3" returned: 0 in 0.573s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-bbe0b0c2-65f6-4f11-878d-1a79c15259f8 tempest-VolumesListTestJSON-65305252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6645b809-cd0d-45ed-955b-24c8b1708af3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:16 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-349998f3-11b8-4cc3-9b15-00d56673231c tempest-CinderUnicodeTest-881212963 None] Created volume successfully. Aug 27 03:53:16 devstack sudo[111061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6645b809-cd0d-45ed-955b-24c8b1708af3 Aug 27 03:53:16 devstack sudo[111061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:16 devstack sudo[111061]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-bbe0b0c2-65f6-4f11-878d-1a79c15259f8 tempest-VolumesListTestJSON-65305252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-6645b809-cd0d-45ed-955b-24c8b1708af3" returned: 0 in 0.483s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:16 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-bbe0b0c2-65f6-4f11-878d-1a79c15259f8 tempest-VolumesListTestJSON-65305252 None] Lock "cinder-quobyte-6645b809-cd0d-45ed-955b-24c8b1708af3" released by "delete_volume" :: held 1.139s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:53:16 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-bbe0b0c2-65f6-4f11-878d-1a79c15259f8 tempest-VolumesListTestJSON-65305252 None] Created reservations ['44cda5c9-160d-422d-8e8a-a414ae5603f6', 'a47dfd67-ac1d-4804-a34b-3f7c0cb67449', '4d4d23c2-c7ed-4a1f-8a00-390caa995475', '5340ce03-a98a-4123-8f80-a1da98c7dd4d'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:53:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-bbe0b0c2-65f6-4f11-878d-1a79c15259f8 tempest-VolumesListTestJSON-65305252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-bbe0b0c2-65f6-4f11-878d-1a79c15259f8 tempest-VolumesListTestJSON-65305252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:16 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-bbe0b0c2-65f6-4f11-878d-1a79c15259f8 tempest-VolumesListTestJSON-65305252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:53:17 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-bbe0b0c2-65f6-4f11-878d-1a79c15259f8 tempest-VolumesListTestJSON-65305252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:53:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-bbe0b0c2-65f6-4f11-878d-1a79c15259f8 tempest-VolumesListTestJSON-65305252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-bbe0b0c2-65f6-4f11-878d-1a79c15259f8 tempest-VolumesListTestJSON-65305252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:17 devstack sudo[111074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:53:17 devstack sudo[111074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-974e673f-a65d-4219-a01b-10727d860973 tempest-CinderUnicodeTest-881212963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-974e673f-a65d-4219-a01b-10727d860973 tempest-CinderUnicodeTest-881212963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:17 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-974e673f-a65d-4219-a01b-10727d860973 tempest-CinderUnicodeTest-881212963 None] Creating offline snapshot c5c91777-d46a-4fb1-8a41-388efb14500a of volume a8b41039-4e4f-48f0-9098-28c2291d8495 {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:53:17 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[7826f8bc-3989-408b-a972-07324fa67fc6]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:53:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-974e673f-a65d-4219-a01b-10727d860973 tempest-CinderUnicodeTest-881212963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:17 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-e4d72cd6-7a09-466a-bbc3-03addf7ce01e req-01034068-4613-4b12-b244-34553b10c4fe tempest-TestMinimumBasicScenario-1972705584 None] Terminate volume connection completed successfully. Aug 27 03:53:17 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-e4d72cd6-7a09-466a-bbc3-03addf7ce01e req-01034068-4613-4b12-b244-34553b10c4fe tempest-TestMinimumBasicScenario-1972705584 None] Deleting attachment cb5f3191-c319-410b-a1a1-1816fe0bae3b. {{(pid=94328) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 27 03:53:17 devstack sudo[111074]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-bbe0b0c2-65f6-4f11-878d-1a79c15259f8 tempest-VolumesListTestJSON-65305252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.502s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:17 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-bbe0b0c2-65f6-4f11-878d-1a79c15259f8 tempest-VolumesListTestJSON-65305252 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:53:17 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-bbe0b0c2-65f6-4f11-878d-1a79c15259f8 tempest-VolumesListTestJSON-65305252 None] Deleted volume successfully. Aug 27 03:53:17 devstack sudo[111082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495 Aug 27 03:53:17 devstack sudo[111082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:17 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-bbe0b0c2-65f6-4f11-878d-1a79c15259f8 tempest-VolumesListTestJSON-65305252 None] Lock "cinder-6645b809-cd0d-45ed-955b-24c8b1708af3-delete_volume" released by "delete_volume" :: held 2.149s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:53:17 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2ed152a6-3f63-4440-8537-7be71390ba6e tempest-VolumesListTestJSON-65305252 None] Acquiring lock "cinder-e381650d-b184-410a-9ac1-c35cf84025df-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:53:17 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2ed152a6-3f63-4440-8537-7be71390ba6e tempest-VolumesListTestJSON-65305252 None] Lock "cinder-e381650d-b184-410a-9ac1-c35cf84025df-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:53:18 devstack sudo[111082]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-974e673f-a65d-4219-a01b-10727d860973 tempest-CinderUnicodeTest-881212963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495" returned: 0 in 0.705s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2ed152a6-3f63-4440-8537-7be71390ba6e tempest-VolumesListTestJSON-65305252 None] Acquiring lock "cinder-quobyte-e381650d-b184-410a-9ac1-c35cf84025df" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:53:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-974e673f-a65d-4219-a01b-10727d860973 tempest-CinderUnicodeTest-881212963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.c5c91777-d46a-4fb1-8a41-388efb14500a 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:18 devstack sudo[111088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.c5c91777-d46a-4fb1-8a41-388efb14500a 1G Aug 27 03:53:18 devstack sudo[111088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2ed152a6-3f63-4440-8537-7be71390ba6e tempest-VolumesListTestJSON-65305252 None] Lock "cinder-quobyte-e381650d-b184-410a-9ac1-c35cf84025df" acquired by "delete_volume" :: waited 0.050s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:53:18 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0100762-1f0d-4a41-8bc3-9216ad82d8c1]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:53:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2ed152a6-3f63-4440-8537-7be71390ba6e tempest-VolumesListTestJSON-65305252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e381650d-b184-410a-9ac1-c35cf84025df {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:18 devstack sudo[111090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e381650d-b184-410a-9ac1-c35cf84025df Aug 27 03:53:18 devstack sudo[111090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:18 devstack sudo[111088]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:18 devstack sudo[111090]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2ed152a6-3f63-4440-8537-7be71390ba6e tempest-VolumesListTestJSON-65305252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e381650d-b184-410a-9ac1-c35cf84025df" returned: 0 in 0.457s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2ed152a6-3f63-4440-8537-7be71390ba6e tempest-VolumesListTestJSON-65305252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e381650d-b184-410a-9ac1-c35cf84025df {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-974e673f-a65d-4219-a01b-10727d860973 tempest-CinderUnicodeTest-881212963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.c5c91777-d46a-4fb1-8a41-388efb14500a 1G" returned: 0 in 0.546s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-974e673f-a65d-4219-a01b-10727d860973 tempest-CinderUnicodeTest-881212963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8b41039-4e4f-48f0-9098-28c2291d8495 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.c5c91777-d46a-4fb1-8a41-388efb14500a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:18 devstack sudo[111099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e381650d-b184-410a-9ac1-c35cf84025df Aug 27 03:53:18 devstack sudo[111099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:18 devstack sudo[111100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8b41039-4e4f-48f0-9098-28c2291d8495 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.c5c91777-d46a-4fb1-8a41-388efb14500a Aug 27 03:53:18 devstack sudo[111100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:18 devstack sudo[111099]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2ed152a6-3f63-4440-8537-7be71390ba6e tempest-VolumesListTestJSON-65305252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e381650d-b184-410a-9ac1-c35cf84025df" returned: 0 in 0.302s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2ed152a6-3f63-4440-8537-7be71390ba6e tempest-VolumesListTestJSON-65305252 None] Lock "cinder-quobyte-e381650d-b184-410a-9ac1-c35cf84025df" released by "delete_volume" :: held 0.815s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:53:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-56ebb973-c451-4f84-add1-2c2b13f55459 tempest-TestMinimumBasicScenario-1972705584 None] Acquiring lock "cinder-2f72bd8f-c6c5-4443-b687-d2ad440aaba6-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:53:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-56ebb973-c451-4f84-add1-2c2b13f55459 tempest-TestMinimumBasicScenario-1972705584 None] Lock "cinder-2f72bd8f-c6c5-4443-b687-d2ad440aaba6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:53:18 devstack sudo[111100]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-974e673f-a65d-4219-a01b-10727d860973 tempest-CinderUnicodeTest-881212963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8b41039-4e4f-48f0-9098-28c2291d8495 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.c5c91777-d46a-4fb1-8a41-388efb14500a" returned: 0 in 0.359s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:18 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-974e673f-a65d-4219-a01b-10727d860973 tempest-CinderUnicodeTest-881212963 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.c5c91777-d46a-4fb1-8a41-388efb14500a is being set with open permissions: ugo+rw Aug 27 03:53:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-974e673f-a65d-4219-a01b-10727d860973 tempest-CinderUnicodeTest-881212963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.c5c91777-d46a-4fb1-8a41-388efb14500a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:18 devstack sudo[111107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.c5c91777-d46a-4fb1-8a41-388efb14500a Aug 27 03:53:18 devstack sudo[111107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-56ebb973-c451-4f84-add1-2c2b13f55459 tempest-TestMinimumBasicScenario-1972705584 None] Acquiring lock "cinder-quobyte-2f72bd8f-c6c5-4443-b687-d2ad440aaba6" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-2ed152a6-3f63-4440-8537-7be71390ba6e tempest-VolumesListTestJSON-65305252 None] Created reservations ['233236ab-9b1d-408f-821d-7e39a928ffa1', 'e7a93f88-f410-47d9-aa16-dc8be6476ff3', '84b87782-68e6-4d3d-b237-2eb56336f773', 'a081a5b5-2071-4301-9adc-40df1e9c3af4'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-56ebb973-c451-4f84-add1-2c2b13f55459 tempest-TestMinimumBasicScenario-1972705584 None] Lock "cinder-quobyte-2f72bd8f-c6c5-4443-b687-d2ad440aaba6" acquired by "delete_volume" :: waited 0.023s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e043bb-c140-48c0-b7ef-b9ee162e0cb5]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-56ebb973-c451-4f84-add1-2c2b13f55459 tempest-TestMinimumBasicScenario-1972705584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2f72bd8f-c6c5-4443-b687-d2ad440aaba6 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2ed152a6-3f63-4440-8537-7be71390ba6e tempest-VolumesListTestJSON-65305252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2ed152a6-3f63-4440-8537-7be71390ba6e tempest-VolumesListTestJSON-65305252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2ed152a6-3f63-4440-8537-7be71390ba6e tempest-VolumesListTestJSON-65305252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2ed152a6-3f63-4440-8537-7be71390ba6e tempest-VolumesListTestJSON-65305252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2ed152a6-3f63-4440-8537-7be71390ba6e tempest-VolumesListTestJSON-65305252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2ed152a6-3f63-4440-8537-7be71390ba6e tempest-VolumesListTestJSON-65305252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:19 devstack sudo[111110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:53:19 devstack sudo[111110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:19 devstack sudo[111109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2f72bd8f-c6c5-4443-b687-d2ad440aaba6 Aug 27 03:53:19 devstack sudo[111109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-afaa752f-6637-4941-ad76-282f1a9dceb1 tempest-VolumesListTestJSON-65305252 None] Acquiring lock "cinder-b9af44fa-96ca-4b9c-a82c-30cc6c0a872d-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-afaa752f-6637-4941-ad76-282f1a9dceb1 tempest-VolumesListTestJSON-65305252 None] Lock "cinder-b9af44fa-96ca-4b9c-a82c-30cc6c0a872d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:53:19 devstack sudo[111107]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-974e673f-a65d-4219-a01b-10727d860973 tempest-CinderUnicodeTest-881212963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.c5c91777-d46a-4fb1-8a41-388efb14500a" returned: 0 in 0.414s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-afaa752f-6637-4941-ad76-282f1a9dceb1 tempest-VolumesListTestJSON-65305252 None] Acquiring lock "cinder-quobyte-b9af44fa-96ca-4b9c-a82c-30cc6c0a872d" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-afaa752f-6637-4941-ad76-282f1a9dceb1 tempest-VolumesListTestJSON-65305252 None] Lock "cinder-quobyte-b9af44fa-96ca-4b9c-a82c-30cc6c0a872d" acquired by "delete_volume" :: waited 0.039s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:53:19 devstack sudo[111110]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-974e673f-a65d-4219-a01b-10727d860973 tempest-CinderUnicodeTest-881212963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[42462c19-0492-4140-9f2c-71b5d85f51e2]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-afaa752f-6637-4941-ad76-282f1a9dceb1 tempest-VolumesListTestJSON-65305252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9af44fa-96ca-4b9c-a82c-30cc6c0a872d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2ed152a6-3f63-4440-8537-7be71390ba6e tempest-VolumesListTestJSON-65305252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.344s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-2ed152a6-3f63-4440-8537-7be71390ba6e tempest-VolumesListTestJSON-65305252 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:53:19 devstack sudo[111115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.info Aug 27 03:53:19 devstack sudo[111115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:19 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-2ed152a6-3f63-4440-8537-7be71390ba6e tempest-VolumesListTestJSON-65305252 None] Deleted volume successfully. Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2ed152a6-3f63-4440-8537-7be71390ba6e tempest-VolumesListTestJSON-65305252 None] Lock "cinder-e381650d-b184-410a-9ac1-c35cf84025df-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:53:19 devstack sudo[111116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9af44fa-96ca-4b9c-a82c-30cc6c0a872d Aug 27 03:53:19 devstack sudo[111116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:19 devstack sudo[111109]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-56ebb973-c451-4f84-add1-2c2b13f55459 tempest-TestMinimumBasicScenario-1972705584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2f72bd8f-c6c5-4443-b687-d2ad440aaba6" returned: 0 in 0.633s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-56ebb973-c451-4f84-add1-2c2b13f55459 tempest-TestMinimumBasicScenario-1972705584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2f72bd8f-c6c5-4443-b687-d2ad440aaba6 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:19 devstack sudo[111122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2f72bd8f-c6c5-4443-b687-d2ad440aaba6 Aug 27 03:53:19 devstack sudo[111122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:19 devstack sudo[111115]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-974e673f-a65d-4219-a01b-10727d860973 tempest-CinderUnicodeTest-881212963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.info" returned: 0 in 0.366s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:19 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-974e673f-a65d-4219-a01b-10727d860973 tempest-CinderUnicodeTest-881212963 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.info is being set with open permissions: ugo+rw Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-974e673f-a65d-4219-a01b-10727d860973 tempest-CinderUnicodeTest-881212963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:19 devstack sudo[111125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.info Aug 27 03:53:19 devstack sudo[111125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:19 devstack sudo[111116]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-afaa752f-6637-4941-ad76-282f1a9dceb1 tempest-VolumesListTestJSON-65305252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9af44fa-96ca-4b9c-a82c-30cc6c0a872d" returned: 0 in 0.515s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-afaa752f-6637-4941-ad76-282f1a9dceb1 tempest-VolumesListTestJSON-65305252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9af44fa-96ca-4b9c-a82c-30cc6c0a872d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:20 devstack sudo[111131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9af44fa-96ca-4b9c-a82c-30cc6c0a872d Aug 27 03:53:20 devstack sudo[111131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:20 devstack sudo[111122]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-56ebb973-c451-4f84-add1-2c2b13f55459 tempest-TestMinimumBasicScenario-1972705584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2f72bd8f-c6c5-4443-b687-d2ad440aaba6" returned: 0 in 0.379s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-56ebb973-c451-4f84-add1-2c2b13f55459 tempest-TestMinimumBasicScenario-1972705584 None] Lock "cinder-quobyte-2f72bd8f-c6c5-4443-b687-d2ad440aaba6" released by "delete_volume" :: held 1.070s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:53:20 devstack sudo[111125]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-974e673f-a65d-4219-a01b-10727d860973 tempest-CinderUnicodeTest-881212963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.info" returned: 0 in 0.327s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-974e673f-a65d-4219-a01b-10727d860973 tempest-CinderUnicodeTest-881212963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.932s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-56ebb973-c451-4f84-add1-2c2b13f55459 tempest-TestMinimumBasicScenario-1972705584 None] Created reservations ['cbabcfb5-0eeb-4b5e-a55e-49fd4a2366c3', '2ca40eb5-4d61-4bf7-bf22-ba354b22b288', 'dcedbf15-dd4b-43b4-a1f0-ff152c6b5421', '9429525e-e76e-4341-bd2a-32543aee4769'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:53:20 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-974e673f-a65d-4219-a01b-10727d860973 tempest-CinderUnicodeTest-881212963 None] Create snapshot completed successfully Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-56ebb973-c451-4f84-add1-2c2b13f55459 tempest-TestMinimumBasicScenario-1972705584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-56ebb973-c451-4f84-add1-2c2b13f55459 tempest-TestMinimumBasicScenario-1972705584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-56ebb973-c451-4f84-add1-2c2b13f55459 tempest-TestMinimumBasicScenario-1972705584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-56ebb973-c451-4f84-add1-2c2b13f55459 tempest-TestMinimumBasicScenario-1972705584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-56ebb973-c451-4f84-add1-2c2b13f55459 tempest-TestMinimumBasicScenario-1972705584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-56ebb973-c451-4f84-add1-2c2b13f55459 tempest-TestMinimumBasicScenario-1972705584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:20 devstack sudo[111135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:53:20 devstack sudo[111135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:20 devstack sudo[111131]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-afaa752f-6637-4941-ad76-282f1a9dceb1 tempest-VolumesListTestJSON-65305252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9af44fa-96ca-4b9c-a82c-30cc6c0a872d" returned: 0 in 0.353s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-afaa752f-6637-4941-ad76-282f1a9dceb1 tempest-VolumesListTestJSON-65305252 None] Lock "cinder-quobyte-b9af44fa-96ca-4b9c-a82c-30cc6c0a872d" released by "delete_volume" :: held 0.938s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f628029e-ab5a-4845-95e5-b8af13ebcc68 tempest-CinderUnicodeTest-881212963 None] Acquiring lock "cinder-c5c91777-d46a-4fb1-8a41-388efb14500a-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f628029e-ab5a-4845-95e5-b8af13ebcc68 tempest-CinderUnicodeTest-881212963 None] Lock "cinder-c5c91777-d46a-4fb1-8a41-388efb14500a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f628029e-ab5a-4845-95e5-b8af13ebcc68 tempest-CinderUnicodeTest-881212963 None] Acquiring lock "cinder-quobyte-a8b41039-4e4f-48f0-9098-28c2291d8495" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-afaa752f-6637-4941-ad76-282f1a9dceb1 tempest-VolumesListTestJSON-65305252 None] Created reservations ['18d0d9fa-f651-4fcf-837b-88e4e5c78467', '6b3f505f-c7ee-4b6b-83b3-678d888f3e4e', '1d0e85b8-f7ee-40d5-a28c-1b41dae7de21', '4542e6db-1034-4400-8a9d-48f2dfa74340'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f628029e-ab5a-4845-95e5-b8af13ebcc68 tempest-CinderUnicodeTest-881212963 None] Lock "cinder-quobyte-a8b41039-4e4f-48f0-9098-28c2291d8495" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f628029e-ab5a-4845-95e5-b8af13ebcc68 tempest-CinderUnicodeTest-881212963 None] Acquiring lock "cinder-quobyte-c5c91777-d46a-4fb1-8a41-388efb14500a" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f628029e-ab5a-4845-95e5-b8af13ebcc68 tempest-CinderUnicodeTest-881212963 None] Lock "cinder-quobyte-c5c91777-d46a-4fb1-8a41-388efb14500a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-f628029e-ab5a-4845-95e5-b8af13ebcc68 tempest-CinderUnicodeTest-881212963 None] Deleting offline snapshot c5c91777-d46a-4fb1-8a41-388efb14500a of volume a8b41039-4e4f-48f0-9098-28c2291d8495 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-f628029e-ab5a-4845-95e5-b8af13ebcc68 tempest-CinderUnicodeTest-881212963 None] snapshot_file for this snap is: volume-a8b41039-4e4f-48f0-9098-28c2291d8495.c5c91777-d46a-4fb1-8a41-388efb14500a {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[adea07c1-79a7-421b-afbf-cdf142128316]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f628029e-ab5a-4845-95e5-b8af13ebcc68 tempest-CinderUnicodeTest-881212963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.c5c91777-d46a-4fb1-8a41-388efb14500a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:20 devstack sudo[111135]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-56ebb973-c451-4f84-add1-2c2b13f55459 tempest-TestMinimumBasicScenario-1972705584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.302s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-56ebb973-c451-4f84-add1-2c2b13f55459 tempest-TestMinimumBasicScenario-1972705584 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-afaa752f-6637-4941-ad76-282f1a9dceb1 tempest-VolumesListTestJSON-65305252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-afaa752f-6637-4941-ad76-282f1a9dceb1 tempest-VolumesListTestJSON-65305252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-afaa752f-6637-4941-ad76-282f1a9dceb1 tempest-VolumesListTestJSON-65305252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-afaa752f-6637-4941-ad76-282f1a9dceb1 tempest-VolumesListTestJSON-65305252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-afaa752f-6637-4941-ad76-282f1a9dceb1 tempest-VolumesListTestJSON-65305252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-afaa752f-6637-4941-ad76-282f1a9dceb1 tempest-VolumesListTestJSON-65305252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:20 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-56ebb973-c451-4f84-add1-2c2b13f55459 tempest-TestMinimumBasicScenario-1972705584 None] Deleted volume successfully. Aug 27 03:53:20 devstack sudo[111139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:53:20 devstack sudo[111139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-56ebb973-c451-4f84-add1-2c2b13f55459 tempest-TestMinimumBasicScenario-1972705584 None] Lock "cinder-2f72bd8f-c6c5-4443-b687-d2ad440aaba6-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:53:20 devstack sudo[111138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.c5c91777-d46a-4fb1-8a41-388efb14500a Aug 27 03:53:20 devstack sudo[111138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:20 devstack sudo[111139]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-afaa752f-6637-4941-ad76-282f1a9dceb1 tempest-VolumesListTestJSON-65305252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.319s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-afaa752f-6637-4941-ad76-282f1a9dceb1 tempest-VolumesListTestJSON-65305252 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:53:20 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-afaa752f-6637-4941-ad76-282f1a9dceb1 tempest-VolumesListTestJSON-65305252 None] Deleted volume successfully. Aug 27 03:53:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-afaa752f-6637-4941-ad76-282f1a9dceb1 tempest-VolumesListTestJSON-65305252 None] Lock "cinder-b9af44fa-96ca-4b9c-a82c-30cc6c0a872d-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:53:21 devstack sudo[111138]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f628029e-ab5a-4845-95e5-b8af13ebcc68 tempest-CinderUnicodeTest-881212963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.c5c91777-d46a-4fb1-8a41-388efb14500a" returned: 0 in 0.472s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:21 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-f628029e-ab5a-4845-95e5-b8af13ebcc68 tempest-CinderUnicodeTest-881212963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8b41039-4e4f-48f0-9098-28c2291d8495(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:53:21 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[c793f273-0168-44a9-a151-6f686f3f2e86]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:53:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f628029e-ab5a-4845-95e5-b8af13ebcc68 tempest-CinderUnicodeTest-881212963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:21 devstack sudo[111147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495 Aug 27 03:53:21 devstack sudo[111147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:21 devstack sudo[111147]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f628029e-ab5a-4845-95e5-b8af13ebcc68 tempest-CinderUnicodeTest-881212963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495" returned: 0 in 0.442s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f628029e-ab5a-4845-95e5-b8af13ebcc68 tempest-CinderUnicodeTest-881212963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.c5c91777-d46a-4fb1-8a41-388efb14500a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:21 devstack sudo[111153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.c5c91777-d46a-4fb1-8a41-388efb14500a Aug 27 03:53:21 devstack sudo[111153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:22 devstack sudo[111153]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f628029e-ab5a-4845-95e5-b8af13ebcc68 tempest-CinderUnicodeTest-881212963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.c5c91777-d46a-4fb1-8a41-388efb14500a" returned: 0 in 0.593s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f628029e-ab5a-4845-95e5-b8af13ebcc68 tempest-CinderUnicodeTest-881212963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.c5c91777-d46a-4fb1-8a41-388efb14500a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:22 devstack sudo[111181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.c5c91777-d46a-4fb1-8a41-388efb14500a Aug 27 03:53:22 devstack sudo[111181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:22 devstack sudo[111181]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f628029e-ab5a-4845-95e5-b8af13ebcc68 tempest-CinderUnicodeTest-881212963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495.c5c91777-d46a-4fb1-8a41-388efb14500a" returned: 0 in 0.384s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:22 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f628029e-ab5a-4845-95e5-b8af13ebcc68 tempest-CinderUnicodeTest-881212963 None] Lock "cinder-quobyte-c5c91777-d46a-4fb1-8a41-388efb14500a" released by "_delete_snapshot" :: held 2.041s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:53:22 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f628029e-ab5a-4845-95e5-b8af13ebcc68 tempest-CinderUnicodeTest-881212963 None] Lock "cinder-quobyte-a8b41039-4e4f-48f0-9098-28c2291d8495" released by "delete_snapshot" :: held 2.075s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:53:22 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-f628029e-ab5a-4845-95e5-b8af13ebcc68 tempest-CinderUnicodeTest-881212963 None] Created reservations ['c41598eb-5f6c-4711-8d48-199bed742b1b', 'f3b59a77-a2d2-4273-aee3-6955b628699d', '89bf8022-942d-4953-ae99-c02f0f2af260', '3f4c039f-d556-46a7-ad5c-d6c1679e3331'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:53:22 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f628029e-ab5a-4845-95e5-b8af13ebcc68 tempest-CinderUnicodeTest-881212963 None] Delete snapshot completed successfully. Aug 27 03:53:22 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f628029e-ab5a-4845-95e5-b8af13ebcc68 tempest-CinderUnicodeTest-881212963 None] Lock "cinder-c5c91777-d46a-4fb1-8a41-388efb14500a-delete_snapshot" released by "delete_snapshot" :: held 2.323s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:53:23 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c02e4aec-76ee-47f0-b7e9-5f900d32d5ef tempest-CinderUnicodeTest-881212963 None] Acquiring lock "cinder-a8b41039-4e4f-48f0-9098-28c2291d8495-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:53:23 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c02e4aec-76ee-47f0-b7e9-5f900d32d5ef tempest-CinderUnicodeTest-881212963 None] Lock "cinder-a8b41039-4e4f-48f0-9098-28c2291d8495-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:53:23 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c02e4aec-76ee-47f0-b7e9-5f900d32d5ef tempest-CinderUnicodeTest-881212963 None] Acquiring lock "cinder-quobyte-a8b41039-4e4f-48f0-9098-28c2291d8495" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:53:23 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c02e4aec-76ee-47f0-b7e9-5f900d32d5ef tempest-CinderUnicodeTest-881212963 None] Lock "cinder-quobyte-a8b41039-4e4f-48f0-9098-28c2291d8495" acquired by "delete_volume" :: waited 0.025s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:53:23 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[909b3168-6300-4664-8429-740e420d2e00]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:53:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c02e4aec-76ee-47f0-b7e9-5f900d32d5ef tempest-CinderUnicodeTest-881212963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:24 devstack sudo[111188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495 Aug 27 03:53:24 devstack sudo[111188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:24 devstack sudo[111188]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c02e4aec-76ee-47f0-b7e9-5f900d32d5ef tempest-CinderUnicodeTest-881212963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495" returned: 0 in 0.589s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c02e4aec-76ee-47f0-b7e9-5f900d32d5ef tempest-CinderUnicodeTest-881212963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:24 devstack sudo[111193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495 Aug 27 03:53:24 devstack sudo[111193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:24 devstack sudo[111193]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c02e4aec-76ee-47f0-b7e9-5f900d32d5ef tempest-CinderUnicodeTest-881212963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a8b41039-4e4f-48f0-9098-28c2291d8495" returned: 0 in 0.263s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:24 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c02e4aec-76ee-47f0-b7e9-5f900d32d5ef tempest-CinderUnicodeTest-881212963 None] Lock "cinder-quobyte-a8b41039-4e4f-48f0-9098-28c2291d8495" released by "delete_volume" :: held 0.969s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:53:24 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-c02e4aec-76ee-47f0-b7e9-5f900d32d5ef tempest-CinderUnicodeTest-881212963 None] Created reservations ['7432a313-41b6-4594-888b-a17a85c8e4d4', '9a790148-ee93-418a-80ff-b3a5e57a8121', '32c5bd73-31c2-42c6-a5dc-98cdbcaa80f3', 'e027b36c-67a5-40f0-909c-52ab8b8e4207'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:53:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c02e4aec-76ee-47f0-b7e9-5f900d32d5ef tempest-CinderUnicodeTest-881212963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c02e4aec-76ee-47f0-b7e9-5f900d32d5ef tempest-CinderUnicodeTest-881212963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c02e4aec-76ee-47f0-b7e9-5f900d32d5ef tempest-CinderUnicodeTest-881212963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:53:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c02e4aec-76ee-47f0-b7e9-5f900d32d5ef tempest-CinderUnicodeTest-881212963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:53:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c02e4aec-76ee-47f0-b7e9-5f900d32d5ef tempest-CinderUnicodeTest-881212963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c02e4aec-76ee-47f0-b7e9-5f900d32d5ef tempest-CinderUnicodeTest-881212963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:25 devstack sudo[111196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:53:25 devstack sudo[111196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:25 devstack sudo[111196]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c02e4aec-76ee-47f0-b7e9-5f900d32d5ef tempest-CinderUnicodeTest-881212963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.295s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:25 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-c02e4aec-76ee-47f0-b7e9-5f900d32d5ef tempest-CinderUnicodeTest-881212963 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:53:25 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-c02e4aec-76ee-47f0-b7e9-5f900d32d5ef tempest-CinderUnicodeTest-881212963 None] Deleted volume successfully. Aug 27 03:53:25 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c02e4aec-76ee-47f0-b7e9-5f900d32d5ef tempest-CinderUnicodeTest-881212963 None] Lock "cinder-a8b41039-4e4f-48f0-9098-28c2291d8495-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:53:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b9b5ecb4-59ec-4c99-92b8-a834e978055e tempest-CinderUnicodeTest-881212963 None] Acquiring lock "cinder-b4bd483a-e75a-4ddb-a73b-a6c15448ac40-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:53:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b9b5ecb4-59ec-4c99-92b8-a834e978055e tempest-CinderUnicodeTest-881212963 None] Lock "cinder-b4bd483a-e75a-4ddb-a73b-a6c15448ac40-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:53:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b9b5ecb4-59ec-4c99-92b8-a834e978055e tempest-CinderUnicodeTest-881212963 None] Acquiring lock "cinder-quobyte-b4bd483a-e75a-4ddb-a73b-a6c15448ac40" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:53:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b9b5ecb4-59ec-4c99-92b8-a834e978055e tempest-CinderUnicodeTest-881212963 None] Lock "cinder-quobyte-b4bd483a-e75a-4ddb-a73b-a6c15448ac40" acquired by "delete_volume" :: waited 0.035s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:53:26 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d0d384-d6cc-468a-9868-898af52b0ae4]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:53:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b9b5ecb4-59ec-4c99-92b8-a834e978055e tempest-CinderUnicodeTest-881212963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b4bd483a-e75a-4ddb-a73b-a6c15448ac40 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:26 devstack sudo[111205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b4bd483a-e75a-4ddb-a73b-a6c15448ac40 Aug 27 03:53:26 devstack sudo[111205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:26 devstack sudo[111205]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b9b5ecb4-59ec-4c99-92b8-a834e978055e tempest-CinderUnicodeTest-881212963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b4bd483a-e75a-4ddb-a73b-a6c15448ac40" returned: 0 in 0.473s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b9b5ecb4-59ec-4c99-92b8-a834e978055e tempest-CinderUnicodeTest-881212963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b4bd483a-e75a-4ddb-a73b-a6c15448ac40 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:26 devstack sudo[111210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b4bd483a-e75a-4ddb-a73b-a6c15448ac40 Aug 27 03:53:26 devstack sudo[111210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:27 devstack sudo[111210]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b9b5ecb4-59ec-4c99-92b8-a834e978055e tempest-CinderUnicodeTest-881212963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b4bd483a-e75a-4ddb-a73b-a6c15448ac40" returned: 0 in 0.437s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:27 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b9b5ecb4-59ec-4c99-92b8-a834e978055e tempest-CinderUnicodeTest-881212963 None] Lock "cinder-quobyte-b4bd483a-e75a-4ddb-a73b-a6c15448ac40" released by "delete_volume" :: held 0.988s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:53:27 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-b9b5ecb4-59ec-4c99-92b8-a834e978055e tempest-CinderUnicodeTest-881212963 None] Created reservations ['9441a237-113a-4d25-b8ef-d7aae9a6c493', 'cdf4592a-f6ef-482c-9f61-84ed657a520c', 'c602970d-b4b6-49c8-9f20-900e194a2e38', 'fc83ac73-d46f-4cbb-8627-9a63723eae18'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:53:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b9b5ecb4-59ec-4c99-92b8-a834e978055e tempest-CinderUnicodeTest-881212963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b9b5ecb4-59ec-4c99-92b8-a834e978055e tempest-CinderUnicodeTest-881212963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b9b5ecb4-59ec-4c99-92b8-a834e978055e tempest-CinderUnicodeTest-881212963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:53:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b9b5ecb4-59ec-4c99-92b8-a834e978055e tempest-CinderUnicodeTest-881212963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:53:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b9b5ecb4-59ec-4c99-92b8-a834e978055e tempest-CinderUnicodeTest-881212963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b9b5ecb4-59ec-4c99-92b8-a834e978055e tempest-CinderUnicodeTest-881212963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:27 devstack sudo[111214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:53:27 devstack sudo[111214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:27 devstack sudo[111214]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b9b5ecb4-59ec-4c99-92b8-a834e978055e tempest-CinderUnicodeTest-881212963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.426s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:27 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-b9b5ecb4-59ec-4c99-92b8-a834e978055e tempest-CinderUnicodeTest-881212963 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:53:27 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-b9b5ecb4-59ec-4c99-92b8-a834e978055e tempest-CinderUnicodeTest-881212963 None] Deleted volume successfully. Aug 27 03:53:27 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b9b5ecb4-59ec-4c99-92b8-a834e978055e tempest-CinderUnicodeTest-881212963 None] Lock "cinder-b4bd483a-e75a-4ddb-a73b-a6c15448ac40-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:53:37 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:UPDATE=116,cinder:DELETE=11,cinder:SELECT=84,cinder:INSERT=35 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:53:37 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:UPDATE=110,cinder:SELECT=90,cinder:INSERT=27,cinder:DELETE=8 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:53:54 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:53:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Flow 'volume_create_manager' (08b8dbc7-84d8-4c70-ac7c-33ff8a5acc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:53:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e33b83-8543-4fdd-a467-37429e2aa44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e33b83-8543-4fdd-a467-37429e2aa44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1498489740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d27159e-87a9-4d60-a1c8-a8e4b0521ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74fae37bd644791b5caa40d35c73e6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:53:54Z,use_quota=True,user_id='4d4f672b1ef24e1d90bac5f79f7d8b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aaf7bbd7-2252-4bd4-8273-cf81cd5f2f4b),volume_type_id=aaf7bbd7-2252-4bd4-8273-cf81cd5f2f4b)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e24bc9-8a1b-4c24-ae59-8b027a020887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e24bc9-8a1b-4c24-ae59-8b027a020887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbc8076-ac6d-4606-b4e2-29d6566cae39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbc8076-ac6d-4606-b4e2-29d6566cae39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d27159e-87a9-4d60-a1c8-a8e4b0521ad5', 'volume_name': 'volume-5d27159e-87a9-4d60-a1c8-a8e4b0521ad5', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552d068e-5832-4bbf-a917-9a27b31774cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552d068e-5832-4bbf-a917-9a27b31774cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab1084c-5cc4-4f19-82bb-46daed6245b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:54 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Volume 5d27159e-87a9-4d60-a1c8-a8e4b0521ad5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d27159e-87a9-4d60-a1c8-a8e4b0521ad5', 'volume_size': 1} Aug 27 03:53:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:54 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1498489740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d27159e-87a9-4d60-a1c8-a8e4b0521ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74fae37bd644791b5caa40d35c73e6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:53:54Z,use_quota=True,user_id='4d4f672b1ef24e1d90bac5f79f7d8b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aaf7bbd7-2252-4bd4-8273-cf81cd5f2f4b),volume_type_id=aaf7bbd7-2252-4bd4-8273-cf81cd5f2f4b)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:53:54 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Creating volume 5d27159e-87a9-4d60-a1c8-a8e4b0521ad5 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:53:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:54 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:53:54 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:53:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:54 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:53:54 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:53:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5d27159e-87a9-4d60-a1c8-a8e4b0521ad5 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:54 devstack sudo[111227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5d27159e-87a9-4d60-a1c8-a8e4b0521ad5 1073741824 Aug 27 03:53:54 devstack sudo[111227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:54 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:53:54 devstack sudo[111227]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Flow 'volume_create_manager' (adef6eab-80dd-40e4-b4fc-1879ae6cf887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a0ff58-11e3-4afb-8faa-45a5c7ccb69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5d27159e-87a9-4d60-a1c8-a8e4b0521ad5 1073741824" returned: 0 in 0.605s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a0ff58-11e3-4afb-8faa-45a5c7ccb69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1269449073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82b4bae5-73b1-4e84-8b7c-8e796b1974d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74fae37bd644791b5caa40d35c73e6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:53:55Z,use_quota=True,user_id='4d4f672b1ef24e1d90bac5f79f7d8b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47f18bdb-8b3c-4d93-a505-ed7d857628f7),volume_type_id=47f18bdb-8b3c-4d93-a505-ed7d857628f7)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4584a2-0599-4428-bdc3-a1113b0624ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4584a2-0599-4428-bdc3-a1113b0624ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695aeaba-f017-4ac7-a2f8-a402fc902503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695aeaba-f017-4ac7-a2f8-a402fc902503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82b4bae5-73b1-4e84-8b7c-8e796b1974d5', 'volume_name': 'volume-82b4bae5-73b1-4e84-8b7c-8e796b1974d5', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff9b344-ccf0-47fe-b13a-201293b16883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff9b344-ccf0-47fe-b13a-201293b16883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d683e764-2f06-43b6-9442-06aa8c6e3b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:55 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Volume 82b4bae5-73b1-4e84-8b7c-8e796b1974d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82b4bae5-73b1-4e84-8b7c-8e796b1974d5', 'volume_size': 1} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5d27159e-87a9-4d60-a1c8-a8e4b0521ad5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:55 devstack sudo[111233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5d27159e-87a9-4d60-a1c8-a8e4b0521ad5 Aug 27 03:53:55 devstack sudo[111233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:55 devstack sudo[111233]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5d27159e-87a9-4d60-a1c8-a8e4b0521ad5" returned: 0 in 0.346s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.405s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1269449073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82b4bae5-73b1-4e84-8b7c-8e796b1974d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74fae37bd644791b5caa40d35c73e6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:53:55Z,use_quota=True,user_id='4d4f672b1ef24e1d90bac5f79f7d8b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47f18bdb-8b3c-4d93-a505-ed7d857628f7),volume_type_id=47f18bdb-8b3c-4d93-a505-ed7d857628f7)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Creating volume 82b4bae5-73b1-4e84-8b7c-8e796b1974d5 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:53:55 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-82b4bae5-73b1-4e84-8b7c-8e796b1974d5 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab1084c-5cc4-4f19-82bb-46daed6245b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d27159e-87a9-4d60-a1c8-a8e4b0521ad5', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:55 devstack sudo[111236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-82b4bae5-73b1-4e84-8b7c-8e796b1974d5 1073741824 Aug 27 03:53:55 devstack sudo[111236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54e31c2-247f-44c0-a0ae-ad1900ac08a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:55 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Volume volume-5d27159e-87a9-4d60-a1c8-a8e4b0521ad5 (5d27159e-87a9-4d60-a1c8-a8e4b0521ad5): created successfully Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54e31c2-247f-44c0-a0ae-ad1900ac08a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Flow 'volume_create_manager' (08b8dbc7-84d8-4c70-ac7c-33ff8a5acc9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:53:55 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e7508b91-a414-4810-bc64-75d48f445eaa tempest-TestInstancesWithCinderVolumes-1222968883 None] Created volume successfully. Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Flow 'volume_create_manager' (6f2fea13-5361-4957-9768-e594df2e7b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2535893-c94f-4e6b-b40e-e67d39249b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2535893-c94f-4e6b-b40e-e67d39249b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-461649706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d853492f-72e4-4e4c-a1fb-ab42e5dedc78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74fae37bd644791b5caa40d35c73e6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:53:56Z,use_quota=True,user_id='4d4f672b1ef24e1d90bac5f79f7d8b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d46f451-dfdb-47f6-b9cd-feefe98b2e45),volume_type_id=0d46f451-dfdb-47f6-b9cd-feefe98b2e45)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62a730f-1133-4a67-adf2-101ff07146ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62a730f-1133-4a67-adf2-101ff07146ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3544de4d-c6c0-41e6-89e2-866a08775faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:55 devstack cinder-volume[94328]: DEBUG cinder.image.glance [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Creating Keystone auth plugin from conf {{(pid=94328) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 27 03:53:56 devstack sudo[111236]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-82b4bae5-73b1-4e84-8b7c-8e796b1974d5 1073741824" returned: 0 in 0.713s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-82b4bae5-73b1-4e84-8b7c-8e796b1974d5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:53:56 devstack sudo[111242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-82b4bae5-73b1-4e84-8b7c-8e796b1974d5 Aug 27 03:53:56 devstack sudo[111242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:53:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3544de4d-c6c0-41e6-89e2-866a08775faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd853492f-72e4-4e4c-a1fb-ab42e5dedc78', 'volume_name': 'volume-d853492f-72e4-4e4c-a1fb-ab42e5dedc78', 'volume_size': 1, 'image_id': 'cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1098026454', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b74fae37bd644791b5caa40d35c73e6f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd', 'created_at': datetime.datetime(2026, 8, 27, 1, 53, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 53, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd/file', 'properties': {}}, 'image_service': }' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:56 devstack sudo[111242]: pam_unix(sudo:session): session closed for user root Aug 27 03:53:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeffa963-238f-4c9c-8304-fccf17b71956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeffa963-238f-4c9c-8304-fccf17b71956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b3af05e-a5f6-49d7-93f7-d0db7c6917e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:56 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Volume d853492f-72e4-4e4c-a1fb-ab42e5dedc78: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d853492f-72e4-4e4c-a1fb-ab42e5dedc78', 'volume_size': 1, 'image_id': 'cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1098026454', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b74fae37bd644791b5caa40d35c73e6f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd', 'created_at': datetime.datetime(2026, 8, 27, 1, 53, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 53, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd/file', 'properties': {}}, 'image_service': } Aug 27 03:53:56 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Trying to clone d853492f-72e4-4e4c-a1fb-ab42e5dedc78 from image cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd at location (None, [{'url': 'file:///opt/stack/data/glance/images/cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd', 'metadata': {}}]). {{(pid=94328) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 27 03:53:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-82b4bae5-73b1-4e84-8b7c-8e796b1974d5" returned: 0 in 0.367s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:53:56 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:53:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:53:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d683e764-2f06-43b6-9442-06aa8c6e3b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82b4bae5-73b1-4e84-8b7c-8e796b1974d5', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3653366-237c-4aed-a091-b462f689f234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:53:56 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Volume volume-82b4bae5-73b1-4e84-8b7c-8e796b1974d5 (82b4bae5-73b1-4e84-8b7c-8e796b1974d5): created successfully Aug 27 03:53:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3653366-237c-4aed-a091-b462f689f234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:53:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Flow 'volume_create_manager' (adef6eab-80dd-40e4-b4fc-1879ae6cf887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:53:56 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-07e52523-fa9a-408d-b487-c620b54aab55 tempest-TestInstancesWithCinderVolumes-1222968883 None] Created volume successfully. Aug 27 03:54:00 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd__rci5xm7devstack@QuobyteHD, size 20.69 MB, duration 3.65 sec {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 27 03:54:00 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Image download 20.69 MB at 5.67 MB/s Aug 27 03:54:00 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb21cc37-2a59-462c-a6c7-bd1af05bb501]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:54:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd__rci5xm7devstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:00 devstack sudo[111246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd__rci5xm7devstack@QuobyteHD Aug 27 03:54:00 devstack sudo[111246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:00 devstack sudo[111246]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd__rci5xm7devstack@QuobyteHD" returned: 0 in 0.371s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:00 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Temporary image cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd is fetched for user 4d4f672b1ef24e1d90bac5f79f7d8b91. {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 27 03:54:00 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2b28ad-d4d5-4e85-9e30-a5699e8d5439]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:54:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd__rci5xm7devstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:00 devstack sudo[111251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd__rci5xm7devstack@QuobyteHD Aug 27 03:54:00 devstack sudo[111251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:01 devstack sudo[111251]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd__rci5xm7devstack@QuobyteHD" returned: 0 in 0.414s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:54:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:54:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-461649706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d853492f-72e4-4e4c-a1fb-ab42e5dedc78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74fae37bd644791b5caa40d35c73e6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:53:56Z,use_quota=True,user_id='4d4f672b1ef24e1d90bac5f79f7d8b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d46f451-dfdb-47f6-b9cd-feefe98b2e45),volume_type_id=0d46f451-dfdb-47f6-b9cd-feefe98b2e45)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:54:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Creating volume d853492f-72e4-4e4c-a1fb-ab42e5dedc78 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:54:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:54:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:54:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:54:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:54:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:54:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:54:01 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:54:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d853492f-72e4-4e4c-a1fb-ab42e5dedc78 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:01 devstack sudo[111256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d853492f-72e4-4e4c-a1fb-ab42e5dedc78 1073741824 Aug 27 03:54:01 devstack sudo[111256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:01 devstack sudo[111256]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d853492f-72e4-4e4c-a1fb-ab42e5dedc78 1073741824" returned: 0 in 0.649s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d853492f-72e4-4e4c-a1fb-ab42e5dedc78 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:01 devstack sudo[111262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d853492f-72e4-4e4c-a1fb-ab42e5dedc78 Aug 27 03:54:01 devstack sudo[111262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:02 devstack sudo[111262]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d853492f-72e4-4e4c-a1fb-ab42e5dedc78" returned: 0 in 0.438s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:02 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:54:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:54:02 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Attempting download of cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd ((None, [{'url': 'file:///opt/stack/data/glance/images/cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd', 'metadata': {}}])) to volume d853492f-72e4-4e4c-a1fb-ab42e5dedc78. {{(pid=94328) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 27 03:54:02 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f7fcca-edf9-4908-87f7-d27463011833]: (4, 'raw') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:54:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd_gad_6zsb {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:02 devstack sudo[111265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd_gad_6zsb Aug 27 03:54:02 devstack sudo[111265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:02 devstack sudo[111265]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd_gad_6zsb" returned: 0 in 0.524s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd_gad_6zsb {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:03 devstack sudo[111269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd_gad_6zsb Aug 27 03:54:03 devstack sudo[111269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:03 devstack sudo[111269]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd_gad_6zsb" returned: 1 in 0.443s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd_gad_6zsb' failed. Not Retrying. {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 27 03:54:03 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[b573f347-2d80-4cfb-a8f9-0817bc8b87c8]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:54:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd__rci5xm7devstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:03 devstack sudo[111276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd__rci5xm7devstack@QuobyteHD Aug 27 03:54:03 devstack sudo[111276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:03 devstack sudo[111276]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd__rci5xm7devstack@QuobyteHD" returned: 0 in 0.415s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:03 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd was qcow2, converting to qcow2 {{(pid=94328) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 27 03:54:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd__rci5xm7devstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d853492f-72e4-4e4c-a1fb-ab42e5dedc78 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:03 devstack sudo[111281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd__rci5xm7devstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d853492f-72e4-4e4c-a1fb-ab42e5dedc78 Aug 27 03:54:03 devstack sudo[111281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:06 devstack sudo[111281]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd__rci5xm7devstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d853492f-72e4-4e4c-a1fb-ab42e5dedc78" returned: 0 in 2.275s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:06 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd__rci5xm7devstack@QuobyteHD, size 112.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d853492f-72e4-4e4c-a1fb-ab42e5dedc78 {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:54:06 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Converted 112.00 MB image at 49.17 MB/s Aug 27 03:54:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d853492f-72e4-4e4c-a1fb-ab42e5dedc78 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:06 devstack sudo[111289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d853492f-72e4-4e4c-a1fb-ab42e5dedc78 1G Aug 27 03:54:06 devstack sudo[111289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:06 devstack sudo[111289]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d853492f-72e4-4e4c-a1fb-ab42e5dedc78 1G" returned: 0 in 0.389s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:06 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Downloaded image cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd ((None, [{'url': 'file:///opt/stack/data/glance/images/cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd', 'metadata': {}}])) to volume d853492f-72e4-4e4c-a1fb-ab42e5dedc78 successfully. {{(pid=94328) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 27 03:54:06 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Temporary image cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd for user 4d4f672b1ef24e1d90bac5f79f7d8b91 is deleted. {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 27 03:54:06 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Marking volume d853492f-72e4-4e4c-a1fb-ab42e5dedc78 as bootable. {{(pid=94328) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 27 03:54:06 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Copying metadata from image cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd to d853492f-72e4-4e4c-a1fb-ab42e5dedc78. {{(pid=94328) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 27 03:54:06 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Creating volume glance metadata for volume d853492f-72e4-4e4c-a1fb-ab42e5dedc78 backed by image cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd with: {'image_id': 'cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd', 'image_name': 'tempest-scenario-img--1098026454', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94328) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 27 03:54:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b3af05e-a5f6-49d7-93f7-d0db7c6917e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d853492f-72e4-4e4c-a1fb-ab42e5dedc78', 'volume_size': 1, 'image_id': 'cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1098026454', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b74fae37bd644791b5caa40d35c73e6f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd', 'created_at': datetime.datetime(2026, 8, 27, 1, 53, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 53, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cdde9f3e-ccc7-4baf-b1ca-0a7f9977d9fd/file', 'properties': {}}, 'image_service': }' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:54:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dab745e-2bf3-436e-a547-36a9708b5838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:54:06 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Volume volume-d853492f-72e4-4e4c-a1fb-ab42e5dedc78 (d853492f-72e4-4e4c-a1fb-ab42e5dedc78): created successfully Aug 27 03:54:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dab745e-2bf3-436e-a547-36a9708b5838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:54:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Flow 'volume_create_manager' (6f2fea13-5361-4957-9768-e594df2e7b99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:54:06 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-95cd43ee-749a-435b-a4a4-1cdedbc488f6 tempest-TestInstancesWithCinderVolumes-1222968883 None] Created volume successfully. Aug 27 03:54:11 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:54:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Flow 'volume_create_manager' (2248d0b0-8515-4433-ab46-66379462ec6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:54:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcadf52c-cc0c-4f7e-85ba-375c1fbb7e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:54:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcadf52c-cc0c-4f7e-85ba-375c1fbb7e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1997184220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94fd57c6-de6d-4d23-bac9-7ce2bd952ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ebfaed38294a338865ba5a023221ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:54:11Z,use_quota=True,user_id='fe77c471d1fc47cd81572f1e5928e595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:54:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c2b440-91b2-4542-980a-10e33a405a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:54:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c2b440-91b2-4542-980a-10e33a405a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:54:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67863b79-c5b9-4be9-9c99-7a00f066cc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:54:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67863b79-c5b9-4be9-9c99-7a00f066cc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94fd57c6-de6d-4d23-bac9-7ce2bd952ec0', 'volume_name': 'volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:54:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0f5846-2d0e-4e27-8c8b-264b59afac04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:54:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0f5846-2d0e-4e27-8c8b-264b59afac04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:54:11 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c6074e3-72a6-4e1d-8f3e-de3f79086ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:54:11 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Volume 94fd57c6-de6d-4d23-bac9-7ce2bd952ec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0', 'volume_size': 1} Aug 27 03:54:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:54:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:54:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1997184220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94fd57c6-de6d-4d23-bac9-7ce2bd952ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ebfaed38294a338865ba5a023221ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:54:11Z,use_quota=True,user_id='fe77c471d1fc47cd81572f1e5928e595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:54:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Creating volume 94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:54:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:54:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:54:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:54:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:54:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:54:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:54:11 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:54:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:11 devstack sudo[111294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 1073741824 Aug 27 03:54:11 devstack sudo[111294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:12 devstack sudo[111294]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 1073741824" returned: 0 in 0.785s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:12 devstack sudo[111303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 Aug 27 03:54:12 devstack sudo[111303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:12 devstack sudo[111303]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0" returned: 0 in 0.366s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:54:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:54:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c6074e3-72a6-4e1d-8f3e-de3f79086ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:54:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0a04c7-7bbb-4215-96a9-6dafad428079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:54:12 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Volume volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 (94fd57c6-de6d-4d23-bac9-7ce2bd952ec0): created successfully Aug 27 03:54:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0a04c7-7bbb-4215-96a9-6dafad428079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:54:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Flow 'volume_create_manager' (2248d0b0-8515-4433-ab46-66379462ec6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:54:12 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-3ca4eca7-e70c-4e8a-8c05-0cccf5c01c34 tempest-SnapshotDependencyTests-241847291 None] Created volume successfully. Aug 27 03:54:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-7e2314f3-9999-4665-9069-06b91e3d49b2 req-af483347-23b5-4eb8-b50d-f227bd42eb06 tempest-TestInstancesWithCinderVolumes-1222968883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:54:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-7e2314f3-9999-4665-9069-06b91e3d49b2 req-af483347-23b5-4eb8-b50d-f227bd42eb06 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:54:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-7e2314f3-9999-4665-9069-06b91e3d49b2 req-af483347-23b5-4eb8-b50d-f227bd42eb06 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:54:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-7e2314f3-9999-4665-9069-06b91e3d49b2 req-af483347-23b5-4eb8-b50d-f227bd42eb06 tempest-TestInstancesWithCinderVolumes-1222968883 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac', 'name': 'volume-d853492f-72e4-4e4c-a1fb-ab42e5dedc78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ef21309-cbb4-4c8d-a298-f0980a413f6f', 'enforce_multipath': True} {{(pid=94328) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 27 03:54:13 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-7e2314f3-9999-4665-9069-06b91e3d49b2 req-af483347-23b5-4eb8-b50d-f227bd42eb06 tempest-TestInstancesWithCinderVolumes-1222968883 None] attachment_update completed successfully. Aug 27 03:54:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6cace2f2-bf7c-4d17-93ca-b340b13d537e tempest-SnapshotDependencyTests-241847291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:54:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6cace2f2-bf7c-4d17-93ca-b340b13d537e tempest-SnapshotDependencyTests-241847291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:54:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-6cace2f2-bf7c-4d17-93ca-b340b13d537e tempest-SnapshotDependencyTests-241847291 None] Creating offline snapshot bc90e1cf-77c0-40fc-a323-901f8b7641a9 of volume 94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:54:14 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[851372b1-915d-47ce-b6be-a03e7a350be2]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:54:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6cace2f2-bf7c-4d17-93ca-b340b13d537e tempest-SnapshotDependencyTests-241847291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:14 devstack sudo[111315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 Aug 27 03:54:14 devstack sudo[111315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:14 devstack sudo[111315]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6cace2f2-bf7c-4d17-93ca-b340b13d537e tempest-SnapshotDependencyTests-241847291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0" returned: 0 in 0.556s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6cace2f2-bf7c-4d17-93ca-b340b13d537e tempest-SnapshotDependencyTests-241847291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.bc90e1cf-77c0-40fc-a323-901f8b7641a9 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:14 devstack sudo[111320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.bc90e1cf-77c0-40fc-a323-901f8b7641a9 1G Aug 27 03:54:14 devstack sudo[111320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:14 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:54:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:54:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:54:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:54:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:54:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:54:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:14 devstack sudo[111324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:54:14 devstack sudo[111324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:15 devstack sudo[111320]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6cace2f2-bf7c-4d17-93ca-b340b13d537e tempest-SnapshotDependencyTests-241847291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.bc90e1cf-77c0-40fc-a323-901f8b7641a9 1G" returned: 0 in 0.538s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6cace2f2-bf7c-4d17-93ca-b340b13d537e tempest-SnapshotDependencyTests-241847291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.bc90e1cf-77c0-40fc-a323-901f8b7641a9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:15 devstack sudo[111324]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.317s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:54:15 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager._thread_info {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:54:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread count: 28 {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 03:54:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread info: [<_MainThread(MainThread, started 134250325188736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 03:54:15 devstack sudo[111329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.bc90e1cf-77c0-40fc-a323-901f8b7641a9 Aug 27 03:54:15 devstack sudo[111329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:15 devstack sudo[111329]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6cace2f2-bf7c-4d17-93ca-b340b13d537e tempest-SnapshotDependencyTests-241847291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.bc90e1cf-77c0-40fc-a323-901f8b7641a9" returned: 0 in 0.425s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:15 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-6cace2f2-bf7c-4d17-93ca-b340b13d537e tempest-SnapshotDependencyTests-241847291 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.bc90e1cf-77c0-40fc-a323-901f8b7641a9 is being set with open permissions: ugo+rw Aug 27 03:54:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6cace2f2-bf7c-4d17-93ca-b340b13d537e tempest-SnapshotDependencyTests-241847291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.bc90e1cf-77c0-40fc-a323-901f8b7641a9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:15 devstack sudo[111336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.bc90e1cf-77c0-40fc-a323-901f8b7641a9 Aug 27 03:54:15 devstack sudo[111336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:15 devstack sudo[111336]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6cace2f2-bf7c-4d17-93ca-b340b13d537e tempest-SnapshotDependencyTests-241847291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.bc90e1cf-77c0-40fc-a323-901f8b7641a9" returned: 0 in 0.283s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6cace2f2-bf7c-4d17-93ca-b340b13d537e tempest-SnapshotDependencyTests-241847291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:16 devstack sudo[111353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.info Aug 27 03:54:16 devstack sudo[111353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:16 devstack sudo[111353]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6cace2f2-bf7c-4d17-93ca-b340b13d537e tempest-SnapshotDependencyTests-241847291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.info" returned: 0 in 0.592s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:16 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-6cace2f2-bf7c-4d17-93ca-b340b13d537e tempest-SnapshotDependencyTests-241847291 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.info is being set with open permissions: ugo+rw Aug 27 03:54:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6cace2f2-bf7c-4d17-93ca-b340b13d537e tempest-SnapshotDependencyTests-241847291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:16 devstack sudo[111380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.info Aug 27 03:54:16 devstack sudo[111380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:16 devstack sudo[111380]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6cace2f2-bf7c-4d17-93ca-b340b13d537e tempest-SnapshotDependencyTests-241847291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.info" returned: 0 in 0.313s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6cace2f2-bf7c-4d17-93ca-b340b13d537e tempest-SnapshotDependencyTests-241847291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.838s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:54:16 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-6cace2f2-bf7c-4d17-93ca-b340b13d537e tempest-SnapshotDependencyTests-241847291 None] Create snapshot completed successfully Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Flow 'volume_create_manager' (7e03b544-b681-475b-a863-65a5c0e1b9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f20a94b-2d16-43d5-8e81-83fe3ed71bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f20a94b-2d16-43d5-8e81-83fe3ed71bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ebfaed38294a338865ba5a023221ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bc90e1cf-77c0-40fc-a323-901f8b7641a9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:54:18Z,use_quota=True,user_id='fe77c471d1fc47cd81572f1e5928e595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (063da03e-8ff0-4b44-885e-ac3c3d6554e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (063da03e-8ff0-4b44-885e-ac3c3d6554e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb37f15-df16-4b58-b10f-b5b539fe8146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb37f15-df16-4b58-b10f-b5b539fe8146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e', 'volume_name': 'volume-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e', 'volume_size': 1, 'snapshot_id': 'bc90e1cf-77c0-40fc-a323-901f8b7641a9'}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e177e0-fa39-402b-bd11-8ef76a06b465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e177e0-fa39-402b-bd11-8ef76a06b465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd47b2b-0c33-4a7b-81d9-ebeae7b147cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:54:18 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Volume 4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e', 'volume_size': 1, 'snapshot_id': 'bc90e1cf-77c0-40fc-a323-901f8b7641a9'} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Acquiring lock "cinder-quobyte-bc90e1cf-77c0-40fc-a323-901f8b7641a9-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e" by "_create_volume_from_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Lock "cinder-quobyte-bc90e1cf-77c0-40fc-a323-901f8b7641a9-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Creating volume 4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e from snapshot bc90e1cf-77c0-40fc-a323-901f8b7641a9 {{(pid=94328) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Acquiring lock "cinder-quobyte-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e" by "_copy_volume_from_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Lock "cinder-quobyte-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] snapshot: bc90e1cf-77c0-40fc-a323-901f8b7641a9, volume: 4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e, {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[25467cf8-28ce-402e-9fba-d334f78df5f3]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:54:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.bc90e1cf-77c0-40fc-a323-901f8b7641a9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:18 devstack sudo[111829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.bc90e1cf-77c0-40fc-a323-901f8b7641a9 Aug 27 03:54:18 devstack sudo[111829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:19 devstack sudo[111829]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.bc90e1cf-77c0-40fc-a323-901f8b7641a9" returned: 0 in 0.451s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:54:19 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff40100-2701-447e-bbdc-82691fdc2841]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:54:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:19 devstack sudo[111851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 Aug 27 03:54:19 devstack sudo[111851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:19 devstack sudo[111851]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0" returned: 0 in 0.542s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] will copy from snapshot at /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 27 03:54:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Creating direct copy from snapshot {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 27 03:54:19 devstack cinder-volume[94328]: DEBUG cinder.utils [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Path /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e not found in is_blk_device check {{(pid=94328) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 27 03:54:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:19 devstack sudo[111857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e Aug 27 03:54:19 devstack sudo[111857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:24 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:54:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Flow 'volume_create_manager' (d000f92d-9dd7-4941-891b-f69f3b7598e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:54:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9eba11-ac61-4ff3-94a3-30be36821156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:54:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9eba11-ac61-4ff3-94a3-30be36821156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1608849787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=806a0689-6f35-40e4-8d39-14109a882378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae711f152734629a96b5cda7e56d8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:54:24Z,use_quota=True,user_id='2e3770040a87493a9b011290631e02fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:54:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05fc6d60-6f5c-4396-9cc1-c2a7c0dbc7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:54:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05fc6d60-6f5c-4396-9cc1-c2a7c0dbc7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:54:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d0613ed-3643-42a6-8803-367ba96f1896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:54:24 devstack cinder-volume[94328]: DEBUG cinder.image.glance [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Creating Keystone auth plugin from conf {{(pid=94328) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 27 03:54:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d0613ed-3643-42a6-8803-367ba96f1896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '806a0689-6f35-40e4-8d39-14109a882378', 'volume_name': 'volume-806a0689-6f35-40e4-8d39-14109a882378', 'volume_size': 1, 'image_id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9b1f4295d504303ad90dfddaa1fb97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'created_at': datetime.datetime(2026, 8, 27, 1, 33, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 33, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f226020c-e698-42bf-8a64-41bbbde77748/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:54:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e1dcd9-e4d5-4760-88a7-df57df82b379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:54:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e1dcd9-e4d5-4760-88a7-df57df82b379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:54:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7fb0cc8-edc4-452e-a8d5-ad68faa858bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:54:26 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Volume 806a0689-6f35-40e4-8d39-14109a882378: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-806a0689-6f35-40e4-8d39-14109a882378', 'volume_size': 1, 'image_id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9b1f4295d504303ad90dfddaa1fb97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'created_at': datetime.datetime(2026, 8, 27, 1, 33, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 33, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f226020c-e698-42bf-8a64-41bbbde77748/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 27 03:54:26 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Trying to clone 806a0689-6f35-40e4-8d39-14109a882378 from image f226020c-e698-42bf-8a64-41bbbde77748 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}]). {{(pid=94328) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 27 03:54:27 devstack sudo[111857]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:27 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_rl1bo5mndevstack@QuobyteHD, size 20.69 MB, duration 1.08 sec {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 27 03:54:27 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Image download 20.69 MB at 19.16 MB/s Aug 27 03:54:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e" returned: 0 in 7.725s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:27 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Image conversion details: src /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0, size 1024.00 MB, duration 7.73 sec, destination /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:54:27 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Converted 1024.00 MB image at 132.54 MB/s Aug 27 03:54:27 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e is being set with open permissions: ugo+rw Aug 27 03:54:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:27 devstack sudo[111879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e Aug 27 03:54:27 devstack sudo[111879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:27 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[579cfa19-4f7c-473f-a1ff-09d4b5ef4642]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:54:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_rl1bo5mndevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:27 devstack sudo[111881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_rl1bo5mndevstack@QuobyteHD Aug 27 03:54:27 devstack sudo[111881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:27 devstack sudo[111879]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e" returned: 0 in 0.365s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:27 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Lock "cinder-quobyte-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e" released by "_copy_volume_from_snapshot" :: held 9.222s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:54:27 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Lock "cinder-quobyte-bc90e1cf-77c0-40fc-a323-901f8b7641a9-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e" released by "_create_volume_from_snapshot" :: held 9.308s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:54:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.327s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd47b2b-0c33-4a7b-81d9-ebeae7b147cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e', 'volume_size': 1, 'snapshot_id': 'bc90e1cf-77c0-40fc-a323-901f8b7641a9'}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45c51287-7642-4f66-bb73-9fded34fcc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:54:28 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Volume volume-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e (4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e): created successfully Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45c51287-7642-4f66-bb73-9fded34fcc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Flow 'volume_create_manager' (7e03b544-b681-475b-a863-65a5c0e1b9e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:54:28 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-740864dc-89f1-42e4-86d9-ade577120c16 tempest-SnapshotDependencyTests-241847291 None] Created volume successfully. Aug 27 03:54:28 devstack sudo[111881]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_rl1bo5mndevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Temporary image f226020c-e698-42bf-8a64-41bbbde77748 is fetched for user 2e3770040a87493a9b011290631e02fc. {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc84dd2-5ba0-4446-8f5a-8790dead6386]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_rl1bo5mndevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:28 devstack sudo[111888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_rl1bo5mndevstack@QuobyteHD Aug 27 03:54:28 devstack sudo[111888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:28 devstack sudo[111888]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_rl1bo5mndevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1608849787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=806a0689-6f35-40e4-8d39-14109a882378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae711f152734629a96b5cda7e56d8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:54:24Z,use_quota=True,user_id='2e3770040a87493a9b011290631e02fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Creating volume 806a0689-6f35-40e4-8d39-14109a882378 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:54:28 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-806a0689-6f35-40e4-8d39-14109a882378 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:28 devstack sudo[111893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-806a0689-6f35-40e4-8d39-14109a882378 1073741824 Aug 27 03:54:28 devstack sudo[111893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e80f2036-1075-471b-bfe7-6b411da62d99 tempest-SnapshotDependencyTests-241847291 None] Acquiring lock "cinder-bc90e1cf-77c0-40fc-a323-901f8b7641a9-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e80f2036-1075-471b-bfe7-6b411da62d99 tempest-SnapshotDependencyTests-241847291 None] Lock "cinder-bc90e1cf-77c0-40fc-a323-901f8b7641a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e80f2036-1075-471b-bfe7-6b411da62d99 tempest-SnapshotDependencyTests-241847291 None] Acquiring lock "cinder-quobyte-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e80f2036-1075-471b-bfe7-6b411da62d99 tempest-SnapshotDependencyTests-241847291 None] Lock "cinder-quobyte-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e80f2036-1075-471b-bfe7-6b411da62d99 tempest-SnapshotDependencyTests-241847291 None] Acquiring lock "cinder-quobyte-bc90e1cf-77c0-40fc-a323-901f8b7641a9" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e80f2036-1075-471b-bfe7-6b411da62d99 tempest-SnapshotDependencyTests-241847291 None] Lock "cinder-quobyte-bc90e1cf-77c0-40fc-a323-901f8b7641a9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:54:28 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-e80f2036-1075-471b-bfe7-6b411da62d99 tempest-SnapshotDependencyTests-241847291 None] Deleting offline snapshot bc90e1cf-77c0-40fc-a323-901f8b7641a9 of volume 94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:54:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-e80f2036-1075-471b-bfe7-6b411da62d99 tempest-SnapshotDependencyTests-241847291 None] snapshot_file for this snap is: volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.bc90e1cf-77c0-40fc-a323-901f8b7641a9 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:54:29 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49ab1d6-0ff8-4bcd-bfea-a319883d6209]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:54:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e80f2036-1075-471b-bfe7-6b411da62d99 tempest-SnapshotDependencyTests-241847291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.bc90e1cf-77c0-40fc-a323-901f8b7641a9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:29 devstack sudo[111900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.bc90e1cf-77c0-40fc-a323-901f8b7641a9 Aug 27 03:54:29 devstack sudo[111900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:29 devstack sudo[111893]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-806a0689-6f35-40e4-8d39-14109a882378 1073741824" returned: 0 in 0.652s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-806a0689-6f35-40e4-8d39-14109a882378 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:29 devstack sudo[111903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-806a0689-6f35-40e4-8d39-14109a882378 Aug 27 03:54:29 devstack sudo[111903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:29 devstack sudo[111903]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-806a0689-6f35-40e4-8d39-14109a882378" returned: 0 in 0.396s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:54:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:54:29 devstack sudo[111900]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e80f2036-1075-471b-bfe7-6b411da62d99 tempest-SnapshotDependencyTests-241847291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.bc90e1cf-77c0-40fc-a323-901f8b7641a9" returned: 0 in 0.656s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-e80f2036-1075-471b-bfe7-6b411da62d99 tempest-SnapshotDependencyTests-241847291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:54:29 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Attempting download of f226020c-e698-42bf-8a64-41bbbde77748 ((None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}])) to volume 806a0689-6f35-40e4-8d39-14109a882378. {{(pid=94328) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 27 03:54:29 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee992f66-bf99-43b3-813b-74160bd1e029]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:54:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e80f2036-1075-471b-bfe7-6b411da62d99 tempest-SnapshotDependencyTests-241847291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:29 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7bd253-5193-4a35-b71b-620a6ea97258]: (4, 'raw') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:54:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_egrcy2rn {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:29 devstack sudo[111914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_egrcy2rn Aug 27 03:54:29 devstack sudo[111914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:29 devstack sudo[111913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 Aug 27 03:54:29 devstack sudo[111913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:30 devstack sudo[111914]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_egrcy2rn" returned: 0 in 0.505s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_egrcy2rn {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:30 devstack sudo[111913]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e80f2036-1075-471b-bfe7-6b411da62d99 tempest-SnapshotDependencyTests-241847291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0" returned: 0 in 0.728s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e80f2036-1075-471b-bfe7-6b411da62d99 tempest-SnapshotDependencyTests-241847291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.bc90e1cf-77c0-40fc-a323-901f8b7641a9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:30 devstack sudo[111921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_egrcy2rn Aug 27 03:54:30 devstack sudo[111921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:30 devstack sudo[111925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.bc90e1cf-77c0-40fc-a323-901f8b7641a9 Aug 27 03:54:30 devstack sudo[111925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:30 devstack sudo[111921]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_egrcy2rn" returned: 1 in 0.455s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f226020c-e698-42bf-8a64-41bbbde77748_egrcy2rn' failed. Not Retrying. {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 27 03:54:30 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f878cc9-ff60-4cc7-b3eb-01ac39772072]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:54:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_rl1bo5mndevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:30 devstack sudo[111925]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e80f2036-1075-471b-bfe7-6b411da62d99 tempest-SnapshotDependencyTests-241847291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.bc90e1cf-77c0-40fc-a323-901f8b7641a9" returned: 0 in 0.416s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e80f2036-1075-471b-bfe7-6b411da62d99 tempest-SnapshotDependencyTests-241847291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.bc90e1cf-77c0-40fc-a323-901f8b7641a9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:30 devstack sudo[111934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.bc90e1cf-77c0-40fc-a323-901f8b7641a9 Aug 27 03:54:30 devstack sudo[111934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:30 devstack sudo[111933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_rl1bo5mndevstack@QuobyteHD Aug 27 03:54:30 devstack sudo[111933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:31 devstack sudo[111934]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e80f2036-1075-471b-bfe7-6b411da62d99 tempest-SnapshotDependencyTests-241847291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0.bc90e1cf-77c0-40fc-a323-901f8b7641a9" returned: 0 in 0.359s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e80f2036-1075-471b-bfe7-6b411da62d99 tempest-SnapshotDependencyTests-241847291 None] Lock "cinder-quobyte-bc90e1cf-77c0-40fc-a323-901f8b7641a9" released by "_delete_snapshot" :: held 2.306s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:54:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e80f2036-1075-471b-bfe7-6b411da62d99 tempest-SnapshotDependencyTests-241847291 None] Lock "cinder-quobyte-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0" released by "delete_snapshot" :: held 2.336s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:54:31 devstack sudo[111933]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_rl1bo5mndevstack@QuobyteHD" returned: 0 in 0.552s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:31 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] f226020c-e698-42bf-8a64-41bbbde77748 was qcow2, converting to qcow2 {{(pid=94328) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 27 03:54:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_rl1bo5mndevstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-806a0689-6f35-40e4-8d39-14109a882378 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:31 devstack sudo[111942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_rl1bo5mndevstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-806a0689-6f35-40e4-8d39-14109a882378 Aug 27 03:54:31 devstack sudo[111942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:31 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-e80f2036-1075-471b-bfe7-6b411da62d99 tempest-SnapshotDependencyTests-241847291 None] Created reservations ['b763748f-5389-4da1-a433-2364af02ea48', '846d8a7d-2c42-4e11-b2ec-c1e533e110d0', '1c4c2036-2f3e-4975-af98-5a4b52be2b44', '80c0593f-2132-4dc0-b4ef-373df6ecded8'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:54:31 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e80f2036-1075-471b-bfe7-6b411da62d99 tempest-SnapshotDependencyTests-241847291 None] Delete snapshot completed successfully. Aug 27 03:54:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e80f2036-1075-471b-bfe7-6b411da62d99 tempest-SnapshotDependencyTests-241847291 None] Lock "cinder-bc90e1cf-77c0-40fc-a323-901f8b7641a9-delete_snapshot" released by "delete_snapshot" :: held 2.570s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:54:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e6701fad-ee4a-40da-9822-24553e9a3fd5 tempest-SnapshotDependencyTests-241847291 None] Acquiring lock "cinder-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:54:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e6701fad-ee4a-40da-9822-24553e9a3fd5 tempest-SnapshotDependencyTests-241847291 None] Lock "cinder-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:54:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e6701fad-ee4a-40da-9822-24553e9a3fd5 tempest-SnapshotDependencyTests-241847291 None] Acquiring lock "cinder-quobyte-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:54:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e6701fad-ee4a-40da-9822-24553e9a3fd5 tempest-SnapshotDependencyTests-241847291 None] Lock "cinder-quobyte-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0" acquired by "delete_volume" :: waited 0.033s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:54:32 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23e4699-94f1-49ce-9e45-2fd10a940a8b]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:54:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e6701fad-ee4a-40da-9822-24553e9a3fd5 tempest-SnapshotDependencyTests-241847291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:32 devstack sudo[111951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 Aug 27 03:54:32 devstack sudo[111951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:32 devstack sudo[111951]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e6701fad-ee4a-40da-9822-24553e9a3fd5 tempest-SnapshotDependencyTests-241847291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0" returned: 0 in 0.456s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e6701fad-ee4a-40da-9822-24553e9a3fd5 tempest-SnapshotDependencyTests-241847291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:32 devstack sudo[111957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0 Aug 27 03:54:32 devstack sudo[111957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:33 devstack sudo[111957]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e6701fad-ee4a-40da-9822-24553e9a3fd5 tempest-SnapshotDependencyTests-241847291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0" returned: 0 in 0.373s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:33 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e6701fad-ee4a-40da-9822-24553e9a3fd5 tempest-SnapshotDependencyTests-241847291 None] Lock "cinder-quobyte-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0" released by "delete_volume" :: held 0.957s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:54:33 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-e6701fad-ee4a-40da-9822-24553e9a3fd5 tempest-SnapshotDependencyTests-241847291 None] Created reservations ['ec584933-4266-47f1-93d9-da0af22ec761', 'ce53afaf-11c6-4db5-8de2-1148bdae4dea', 'e4599edc-b572-44aa-a4a9-2c4fdf790730', 'be049cf5-f965-46b7-bcd2-3e5b52d54e84'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:54:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e6701fad-ee4a-40da-9822-24553e9a3fd5 tempest-SnapshotDependencyTests-241847291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:54:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e6701fad-ee4a-40da-9822-24553e9a3fd5 tempest-SnapshotDependencyTests-241847291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:54:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e6701fad-ee4a-40da-9822-24553e9a3fd5 tempest-SnapshotDependencyTests-241847291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:54:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e6701fad-ee4a-40da-9822-24553e9a3fd5 tempest-SnapshotDependencyTests-241847291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:54:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e6701fad-ee4a-40da-9822-24553e9a3fd5 tempest-SnapshotDependencyTests-241847291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:54:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e6701fad-ee4a-40da-9822-24553e9a3fd5 tempest-SnapshotDependencyTests-241847291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:33 devstack sudo[111962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:54:33 devstack sudo[111962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:33 devstack sudo[111942]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_rl1bo5mndevstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-806a0689-6f35-40e4-8d39-14109a882378" returned: 0 in 2.437s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:33 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f226020c-e698-42bf-8a64-41bbbde77748_rl1bo5mndevstack@QuobyteHD, size 112.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-806a0689-6f35-40e4-8d39-14109a882378 {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:54:33 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Converted 112.00 MB image at 45.90 MB/s Aug 27 03:54:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-806a0689-6f35-40e4-8d39-14109a882378 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:33 devstack sudo[111964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-806a0689-6f35-40e4-8d39-14109a882378 1G Aug 27 03:54:33 devstack sudo[111964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:34 devstack sudo[111962]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e6701fad-ee4a-40da-9822-24553e9a3fd5 tempest-SnapshotDependencyTests-241847291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.477s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:34 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-e6701fad-ee4a-40da-9822-24553e9a3fd5 tempest-SnapshotDependencyTests-241847291 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:54:34 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e6701fad-ee4a-40da-9822-24553e9a3fd5 tempest-SnapshotDependencyTests-241847291 None] Deleted volume successfully. Aug 27 03:54:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e6701fad-ee4a-40da-9822-24553e9a3fd5 tempest-SnapshotDependencyTests-241847291 None] Lock "cinder-94fd57c6-de6d-4d23-bac9-7ce2bd952ec0-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:54:34 devstack sudo[111964]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-806a0689-6f35-40e4-8d39-14109a882378 1G" returned: 0 in 0.445s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:34 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Downloaded image f226020c-e698-42bf-8a64-41bbbde77748 ((None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}])) to volume 806a0689-6f35-40e4-8d39-14109a882378 successfully. {{(pid=94328) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 27 03:54:34 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Temporary image f226020c-e698-42bf-8a64-41bbbde77748 for user 2e3770040a87493a9b011290631e02fc is deleted. {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 27 03:54:34 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Marking volume 806a0689-6f35-40e4-8d39-14109a882378 as bootable. {{(pid=94328) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 27 03:54:34 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Copying metadata from image f226020c-e698-42bf-8a64-41bbbde77748 to 806a0689-6f35-40e4-8d39-14109a882378. {{(pid=94328) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 27 03:54:34 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Creating volume glance metadata for volume 806a0689-6f35-40e4-8d39-14109a882378 backed by image f226020c-e698-42bf-8a64-41bbbde77748 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94328) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 27 03:54:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7fb0cc8-edc4-452e-a8d5-ad68faa858bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-806a0689-6f35-40e4-8d39-14109a882378', 'volume_size': 1, 'image_id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f226020c-e698-42bf-8a64-41bbbde77748', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e9b1f4295d504303ad90dfddaa1fb97d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f226020c-e698-42bf-8a64-41bbbde77748', 'created_at': datetime.datetime(2026, 8, 27, 1, 33, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 33, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f226020c-e698-42bf-8a64-41bbbde77748/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:54:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (920319ee-ace0-445e-983f-5e884f5248de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:54:34 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Volume volume-806a0689-6f35-40e4-8d39-14109a882378 (806a0689-6f35-40e4-8d39-14109a882378): created successfully Aug 27 03:54:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (920319ee-ace0-445e-983f-5e884f5248de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:54:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Flow 'volume_create_manager' (d000f92d-9dd7-4941-891b-f69f3b7598e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:54:34 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-510164fb-09e4-4a4f-a0bc-044a846e9142 tempest-TestShelveInstance-1534771150 None] Created volume successfully. Aug 27 03:54:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9cbbd1ed-71d2-4ca1-83fd-79a7760c6d0e tempest-SnapshotDependencyTests-241847291 None] Acquiring lock "cinder-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:54:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9cbbd1ed-71d2-4ca1-83fd-79a7760c6d0e tempest-SnapshotDependencyTests-241847291 None] Lock "cinder-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:54:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9cbbd1ed-71d2-4ca1-83fd-79a7760c6d0e tempest-SnapshotDependencyTests-241847291 None] Acquiring lock "cinder-quobyte-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:54:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9cbbd1ed-71d2-4ca1-83fd-79a7760c6d0e tempest-SnapshotDependencyTests-241847291 None] Lock "cinder-quobyte-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e" acquired by "delete_volume" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:54:34 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[065d5a80-aae6-45ea-9245-acf348d6bfe6]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:54:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9cbbd1ed-71d2-4ca1-83fd-79a7760c6d0e tempest-SnapshotDependencyTests-241847291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:34 devstack sudo[111971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e Aug 27 03:54:34 devstack sudo[111971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:35 devstack sudo[111971]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9cbbd1ed-71d2-4ca1-83fd-79a7760c6d0e tempest-SnapshotDependencyTests-241847291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e" returned: 0 in 0.426s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9cbbd1ed-71d2-4ca1-83fd-79a7760c6d0e tempest-SnapshotDependencyTests-241847291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:35 devstack sudo[111976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e Aug 27 03:54:35 devstack sudo[111976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:35 devstack sudo[111976]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9cbbd1ed-71d2-4ca1-83fd-79a7760c6d0e tempest-SnapshotDependencyTests-241847291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e" returned: 0 in 0.292s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:35 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9cbbd1ed-71d2-4ca1-83fd-79a7760c6d0e tempest-SnapshotDependencyTests-241847291 None] Lock "cinder-quobyte-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e" released by "delete_volume" :: held 0.769s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:54:35 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-9cbbd1ed-71d2-4ca1-83fd-79a7760c6d0e tempest-SnapshotDependencyTests-241847291 None] Created reservations ['4c2fe080-39ff-4753-90b9-d5d9f5712a4a', '6cc1173e-9968-4980-a871-21c673384fe9', 'ee86e113-8cd7-4fd2-bb82-52ca1596bce0', '92600423-1ae6-4976-97a9-4e54f25cd3f0'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:54:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9cbbd1ed-71d2-4ca1-83fd-79a7760c6d0e tempest-SnapshotDependencyTests-241847291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:54:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9cbbd1ed-71d2-4ca1-83fd-79a7760c6d0e tempest-SnapshotDependencyTests-241847291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:54:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-9cbbd1ed-71d2-4ca1-83fd-79a7760c6d0e tempest-SnapshotDependencyTests-241847291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:54:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-9cbbd1ed-71d2-4ca1-83fd-79a7760c6d0e tempest-SnapshotDependencyTests-241847291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:54:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9cbbd1ed-71d2-4ca1-83fd-79a7760c6d0e tempest-SnapshotDependencyTests-241847291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:54:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9cbbd1ed-71d2-4ca1-83fd-79a7760c6d0e tempest-SnapshotDependencyTests-241847291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:54:35 devstack sudo[111979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:54:35 devstack sudo[111979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:54:35 devstack sudo[111979]: pam_unix(sudo:session): session closed for user root Aug 27 03:54:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9cbbd1ed-71d2-4ca1-83fd-79a7760c6d0e tempest-SnapshotDependencyTests-241847291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.386s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:54:35 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-9cbbd1ed-71d2-4ca1-83fd-79a7760c6d0e tempest-SnapshotDependencyTests-241847291 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:54:35 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-9cbbd1ed-71d2-4ca1-83fd-79a7760c6d0e tempest-SnapshotDependencyTests-241847291 None] Deleted volume successfully. Aug 27 03:54:35 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9cbbd1ed-71d2-4ca1-83fd-79a7760c6d0e tempest-SnapshotDependencyTests-241847291 None] Lock "cinder-4bd8e8bb-9207-4934-8d6b-8ed6fa6db03e-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:54:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-06d47692-ce46-4e1b-9e48-ab4a8b1fbe95 req-ca71fc6c-07ac-444a-aec4-a16782df79b1 tempest-TestShelveInstance-1534771150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:54:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-06d47692-ce46-4e1b-9e48-ab4a8b1fbe95 req-ca71fc6c-07ac-444a-aec4-a16782df79b1 tempest-TestShelveInstance-1534771150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:54:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-06d47692-ce46-4e1b-9e48-ab4a8b1fbe95 req-ca71fc6c-07ac-444a-aec4-a16782df79b1 tempest-TestShelveInstance-1534771150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:54:37 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-06d47692-ce46-4e1b-9e48-ab4a8b1fbe95 req-ca71fc6c-07ac-444a-aec4-a16782df79b1 tempest-TestShelveInstance-1534771150 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac', 'name': 'volume-806a0689-6f35-40e4-8d39-14109a882378', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3edec19f-4935-4f4f-8ffd-838400cc7bc3', 'enforce_multipath': True} {{(pid=94328) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 27 03:54:37 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-06d47692-ce46-4e1b-9e48-ab4a8b1fbe95 req-ca71fc6c-07ac-444a-aec4-a16782df79b1 tempest-TestShelveInstance-1534771150 None] attachment_update completed successfully. Aug 27 03:54:47 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=55,cinder:UPDATE=44,cinder:DELETE=2,cinder:INSERT=21 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:54:47 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=63,cinder:UPDATE=51,cinder:INSERT=20,cinder:DELETE=7 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:54:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-19a0c569-532e-4e1a-8af2-43fdedb3a4a2 req-45c4b716-a315-4fc4-8335-8226a46c9835 tempest-TestInstancesWithCinderVolumes-1222968883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:54:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-19a0c569-532e-4e1a-8af2-43fdedb3a4a2 req-45c4b716-a315-4fc4-8335-8226a46c9835 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:54:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-19a0c569-532e-4e1a-8af2-43fdedb3a4a2 req-45c4b716-a315-4fc4-8335-8226a46c9835 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:54:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-19a0c569-532e-4e1a-8af2-43fdedb3a4a2 req-45c4b716-a315-4fc4-8335-8226a46c9835 tempest-TestInstancesWithCinderVolumes-1222968883 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac', 'name': 'volume-5d27159e-87a9-4d60-a1c8-a8e4b0521ad5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5c9aca4b-c7a4-402c-9f7f-9b7ee4ae986a', 'enforce_multipath': True} {{(pid=94328) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 27 03:54:54 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-19a0c569-532e-4e1a-8af2-43fdedb3a4a2 req-45c4b716-a315-4fc4-8335-8226a46c9835 tempest-TestInstancesWithCinderVolumes-1222968883 None] attachment_update completed successfully. Aug 27 03:54:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-92f74f29-708d-4d23-ae78-d071dcc5e9ec req-2a822a73-543e-420f-8874-01403ed1ccac tempest-TestInstancesWithCinderVolumes-1222968883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:54:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-92f74f29-708d-4d23-ae78-d071dcc5e9ec req-2a822a73-543e-420f-8874-01403ed1ccac tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:54:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-92f74f29-708d-4d23-ae78-d071dcc5e9ec req-2a822a73-543e-420f-8874-01403ed1ccac tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:54:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-92f74f29-708d-4d23-ae78-d071dcc5e9ec req-2a822a73-543e-420f-8874-01403ed1ccac tempest-TestInstancesWithCinderVolumes-1222968883 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac', 'name': 'volume-82b4bae5-73b1-4e84-8b7c-8e796b1974d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2cf6b020-f5a5-491b-8a8c-02ce3b52909e', 'enforce_multipath': True} {{(pid=94328) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 27 03:54:56 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-92f74f29-708d-4d23-ae78-d071dcc5e9ec req-2a822a73-543e-420f-8874-01403ed1ccac tempest-TestInstancesWithCinderVolumes-1222968883 None] attachment_update completed successfully. Aug 27 03:55:01 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-5cd017d4-74c2-41c2-b9ba-ca9178e3eeb0 req-084c205d-9508-43e9-bb06-839a9383607d tempest-TestInstancesWithCinderVolumes-1222968883 None] Terminate volume connection completed successfully. Aug 27 03:55:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-5cd017d4-74c2-41c2-b9ba-ca9178e3eeb0 req-084c205d-9508-43e9-bb06-839a9383607d tempest-TestInstancesWithCinderVolumes-1222968883 None] Deleting attachment 5c9aca4b-c7a4-402c-9f7f-9b7ee4ae986a. {{(pid=94328) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 27 03:55:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0286aa27-4d17-4826-9b58-62ca64cfa4f5 tempest-TestInstancesWithCinderVolumes-1222968883 None] Acquiring lock "cinder-5d27159e-87a9-4d60-a1c8-a8e4b0521ad5-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:55:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0286aa27-4d17-4826-9b58-62ca64cfa4f5 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "cinder-5d27159e-87a9-4d60-a1c8-a8e4b0521ad5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:55:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0286aa27-4d17-4826-9b58-62ca64cfa4f5 tempest-TestInstancesWithCinderVolumes-1222968883 None] Acquiring lock "cinder-quobyte-5d27159e-87a9-4d60-a1c8-a8e4b0521ad5" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:55:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0286aa27-4d17-4826-9b58-62ca64cfa4f5 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "cinder-quobyte-5d27159e-87a9-4d60-a1c8-a8e4b0521ad5" acquired by "delete_volume" :: waited 0.014s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:55:02 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[222a5472-c7c7-47de-a90b-c5ed8cae889c]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:55:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0286aa27-4d17-4826-9b58-62ca64cfa4f5 tempest-TestInstancesWithCinderVolumes-1222968883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5d27159e-87a9-4d60-a1c8-a8e4b0521ad5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:55:02 devstack sudo[112212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5d27159e-87a9-4d60-a1c8-a8e4b0521ad5 Aug 27 03:55:02 devstack sudo[112212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:55:02 devstack sudo[112212]: pam_unix(sudo:session): session closed for user root Aug 27 03:55:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0286aa27-4d17-4826-9b58-62ca64cfa4f5 tempest-TestInstancesWithCinderVolumes-1222968883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5d27159e-87a9-4d60-a1c8-a8e4b0521ad5" returned: 0 in 0.402s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:55:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0286aa27-4d17-4826-9b58-62ca64cfa4f5 tempest-TestInstancesWithCinderVolumes-1222968883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5d27159e-87a9-4d60-a1c8-a8e4b0521ad5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:55:02 devstack sudo[112219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5d27159e-87a9-4d60-a1c8-a8e4b0521ad5 Aug 27 03:55:02 devstack sudo[112219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:55:02 devstack sudo[112219]: pam_unix(sudo:session): session closed for user root Aug 27 03:55:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0286aa27-4d17-4826-9b58-62ca64cfa4f5 tempest-TestInstancesWithCinderVolumes-1222968883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5d27159e-87a9-4d60-a1c8-a8e4b0521ad5" returned: 0 in 0.252s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:55:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0286aa27-4d17-4826-9b58-62ca64cfa4f5 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "cinder-quobyte-5d27159e-87a9-4d60-a1c8-a8e4b0521ad5" released by "delete_volume" :: held 0.696s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:55:02 devstack cinder-volume[94328]: WARNING cinder.quota [None req-0286aa27-4d17-4826-9b58-62ca64cfa4f5 tempest-TestInstancesWithCinderVolumes-1222968883 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-820229675-2029772727 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-820229675-2029772727, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:55:02 devstack cinder-volume[94328]: WARNING cinder.quota [None req-0286aa27-4d17-4826-9b58-62ca64cfa4f5 tempest-TestInstancesWithCinderVolumes-1222968883 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-820229675-2029772727 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-820229675-2029772727, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:55:02 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-0286aa27-4d17-4826-9b58-62ca64cfa4f5 tempest-TestInstancesWithCinderVolumes-1222968883 None] Created reservations ['c2ccb7b5-fbee-4b31-b0b1-06287678b689', '391f326a-5fd8-428e-8b63-c5bb97236ad6', '0fc793af-ac65-4ea4-ae44-eb2b675c38dd', 'f6b5779d-7c64-410d-8a78-301d8e18ffc2'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:55:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0286aa27-4d17-4826-9b58-62ca64cfa4f5 tempest-TestInstancesWithCinderVolumes-1222968883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:55:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0286aa27-4d17-4826-9b58-62ca64cfa4f5 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:55:02 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0286aa27-4d17-4826-9b58-62ca64cfa4f5 tempest-TestInstancesWithCinderVolumes-1222968883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:55:02 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0286aa27-4d17-4826-9b58-62ca64cfa4f5 tempest-TestInstancesWithCinderVolumes-1222968883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:55:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0286aa27-4d17-4826-9b58-62ca64cfa4f5 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:55:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0286aa27-4d17-4826-9b58-62ca64cfa4f5 tempest-TestInstancesWithCinderVolumes-1222968883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:55:02 devstack sudo[112222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:55:02 devstack sudo[112222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:55:03 devstack sudo[112222]: pam_unix(sudo:session): session closed for user root Aug 27 03:55:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0286aa27-4d17-4826-9b58-62ca64cfa4f5 tempest-TestInstancesWithCinderVolumes-1222968883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.290s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:55:03 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-0286aa27-4d17-4826-9b58-62ca64cfa4f5 tempest-TestInstancesWithCinderVolumes-1222968883 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:55:03 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-0286aa27-4d17-4826-9b58-62ca64cfa4f5 tempest-TestInstancesWithCinderVolumes-1222968883 None] Deleted volume successfully. Aug 27 03:55:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0286aa27-4d17-4826-9b58-62ca64cfa4f5 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "cinder-5d27159e-87a9-4d60-a1c8-a8e4b0521ad5-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:55:05 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-7bf60822-6765-4b2b-bbf3-18ddf332bcd2 req-d5dc67c7-6e22-4f53-b5ce-7b7618348a4a tempest-TestInstancesWithCinderVolumes-1222968883 None] Terminate volume connection completed successfully. Aug 27 03:55:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-7bf60822-6765-4b2b-bbf3-18ddf332bcd2 req-d5dc67c7-6e22-4f53-b5ce-7b7618348a4a tempest-TestInstancesWithCinderVolumes-1222968883 None] Deleting attachment 2cf6b020-f5a5-491b-8a8c-02ce3b52909e. {{(pid=94328) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 27 03:55:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-85954acc-9a9f-439f-b927-2f43239c5662 tempest-TestInstancesWithCinderVolumes-1222968883 None] Acquiring lock "cinder-82b4bae5-73b1-4e84-8b7c-8e796b1974d5-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:55:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-85954acc-9a9f-439f-b927-2f43239c5662 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "cinder-82b4bae5-73b1-4e84-8b7c-8e796b1974d5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:55:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-85954acc-9a9f-439f-b927-2f43239c5662 tempest-TestInstancesWithCinderVolumes-1222968883 None] Acquiring lock "cinder-quobyte-82b4bae5-73b1-4e84-8b7c-8e796b1974d5" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:55:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-85954acc-9a9f-439f-b927-2f43239c5662 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "cinder-quobyte-82b4bae5-73b1-4e84-8b7c-8e796b1974d5" acquired by "delete_volume" :: waited 0.014s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:55:06 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[6610b245-acd0-4843-91f1-550db8580150]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:55:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85954acc-9a9f-439f-b927-2f43239c5662 tempest-TestInstancesWithCinderVolumes-1222968883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-82b4bae5-73b1-4e84-8b7c-8e796b1974d5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:55:06 devstack sudo[112253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-82b4bae5-73b1-4e84-8b7c-8e796b1974d5 Aug 27 03:55:06 devstack sudo[112253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:55:06 devstack sudo[112253]: pam_unix(sudo:session): session closed for user root Aug 27 03:55:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85954acc-9a9f-439f-b927-2f43239c5662 tempest-TestInstancesWithCinderVolumes-1222968883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-82b4bae5-73b1-4e84-8b7c-8e796b1974d5" returned: 0 in 0.380s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:55:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85954acc-9a9f-439f-b927-2f43239c5662 tempest-TestInstancesWithCinderVolumes-1222968883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-82b4bae5-73b1-4e84-8b7c-8e796b1974d5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:55:06 devstack sudo[112258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-82b4bae5-73b1-4e84-8b7c-8e796b1974d5 Aug 27 03:55:06 devstack sudo[112258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:55:07 devstack sudo[112258]: pam_unix(sudo:session): session closed for user root Aug 27 03:55:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85954acc-9a9f-439f-b927-2f43239c5662 tempest-TestInstancesWithCinderVolumes-1222968883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-82b4bae5-73b1-4e84-8b7c-8e796b1974d5" returned: 0 in 0.269s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:55:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-85954acc-9a9f-439f-b927-2f43239c5662 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "cinder-quobyte-82b4bae5-73b1-4e84-8b7c-8e796b1974d5" released by "delete_volume" :: held 0.706s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:55:07 devstack cinder-volume[94328]: WARNING cinder.quota [None req-85954acc-9a9f-439f-b927-2f43239c5662 tempest-TestInstancesWithCinderVolumes-1222968883 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1987596612-847666351 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1987596612-847666351, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:55:07 devstack cinder-volume[94328]: WARNING cinder.quota [None req-85954acc-9a9f-439f-b927-2f43239c5662 tempest-TestInstancesWithCinderVolumes-1222968883 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1987596612-847666351 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1987596612-847666351, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:55:07 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-85954acc-9a9f-439f-b927-2f43239c5662 tempest-TestInstancesWithCinderVolumes-1222968883 None] Created reservations ['15307870-72fc-4547-a84d-4ebd7b81bb78', 'ade4f58c-e43b-4bd5-b800-f2336b361365', 'a83b3e02-fae0-4124-82ec-f011096b2561', '82c77c72-c0d5-42e6-a52b-810a7b4a89c3'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:55:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-85954acc-9a9f-439f-b927-2f43239c5662 tempest-TestInstancesWithCinderVolumes-1222968883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:55:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-85954acc-9a9f-439f-b927-2f43239c5662 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:55:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-85954acc-9a9f-439f-b927-2f43239c5662 tempest-TestInstancesWithCinderVolumes-1222968883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:55:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-85954acc-9a9f-439f-b927-2f43239c5662 tempest-TestInstancesWithCinderVolumes-1222968883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:55:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-85954acc-9a9f-439f-b927-2f43239c5662 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:55:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85954acc-9a9f-439f-b927-2f43239c5662 tempest-TestInstancesWithCinderVolumes-1222968883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:55:07 devstack sudo[112262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:55:07 devstack sudo[112262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:55:07 devstack sudo[112262]: pam_unix(sudo:session): session closed for user root Aug 27 03:55:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-85954acc-9a9f-439f-b927-2f43239c5662 tempest-TestInstancesWithCinderVolumes-1222968883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.325s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:55:07 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-85954acc-9a9f-439f-b927-2f43239c5662 tempest-TestInstancesWithCinderVolumes-1222968883 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:55:07 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-85954acc-9a9f-439f-b927-2f43239c5662 tempest-TestInstancesWithCinderVolumes-1222968883 None] Deleted volume successfully. Aug 27 03:55:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-85954acc-9a9f-439f-b927-2f43239c5662 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "cinder-82b4bae5-73b1-4e84-8b7c-8e796b1974d5-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:55:10 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-516e37bc-a936-4ae5-a283-d24977c0bce5 req-128c8411-ab74-4f99-a883-ae27f244c609 tempest-TestInstancesWithCinderVolumes-1222968883 None] Terminate volume connection completed successfully. Aug 27 03:55:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-516e37bc-a936-4ae5-a283-d24977c0bce5 req-128c8411-ab74-4f99-a883-ae27f244c609 tempest-TestInstancesWithCinderVolumes-1222968883 None] Deleting attachment 3ef21309-cbb4-4c8d-a298-f0980a413f6f. {{(pid=94328) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 27 03:55:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e65b2917-4ef0-4111-b2a8-748b2418be20 tempest-TestInstancesWithCinderVolumes-1222968883 None] Acquiring lock "cinder-d853492f-72e4-4e4c-a1fb-ab42e5dedc78-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:55:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e65b2917-4ef0-4111-b2a8-748b2418be20 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "cinder-d853492f-72e4-4e4c-a1fb-ab42e5dedc78-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:55:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e65b2917-4ef0-4111-b2a8-748b2418be20 tempest-TestInstancesWithCinderVolumes-1222968883 None] Acquiring lock "cinder-quobyte-d853492f-72e4-4e4c-a1fb-ab42e5dedc78" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:55:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e65b2917-4ef0-4111-b2a8-748b2418be20 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "cinder-quobyte-d853492f-72e4-4e4c-a1fb-ab42e5dedc78" acquired by "delete_volume" :: waited 0.019s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:55:11 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[166e056b-8a7a-4bbf-b368-360875c26426]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:55:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e65b2917-4ef0-4111-b2a8-748b2418be20 tempest-TestInstancesWithCinderVolumes-1222968883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d853492f-72e4-4e4c-a1fb-ab42e5dedc78 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:55:11 devstack sudo[112723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d853492f-72e4-4e4c-a1fb-ab42e5dedc78 Aug 27 03:55:11 devstack sudo[112723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:55:12 devstack sudo[112723]: pam_unix(sudo:session): session closed for user root Aug 27 03:55:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e65b2917-4ef0-4111-b2a8-748b2418be20 tempest-TestInstancesWithCinderVolumes-1222968883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d853492f-72e4-4e4c-a1fb-ab42e5dedc78" returned: 0 in 0.368s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:55:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e65b2917-4ef0-4111-b2a8-748b2418be20 tempest-TestInstancesWithCinderVolumes-1222968883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d853492f-72e4-4e4c-a1fb-ab42e5dedc78 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:55:12 devstack sudo[112728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d853492f-72e4-4e4c-a1fb-ab42e5dedc78 Aug 27 03:55:12 devstack sudo[112728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:55:12 devstack sudo[112728]: pam_unix(sudo:session): session closed for user root Aug 27 03:55:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e65b2917-4ef0-4111-b2a8-748b2418be20 tempest-TestInstancesWithCinderVolumes-1222968883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d853492f-72e4-4e4c-a1fb-ab42e5dedc78" returned: 0 in 0.282s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:55:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e65b2917-4ef0-4111-b2a8-748b2418be20 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "cinder-quobyte-d853492f-72e4-4e4c-a1fb-ab42e5dedc78" released by "delete_volume" :: held 0.692s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:55:12 devstack cinder-volume[94328]: WARNING cinder.quota [None req-e65b2917-4ef0-4111-b2a8-748b2418be20 tempest-TestInstancesWithCinderVolumes-1222968883 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1215677298-48340682 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1215677298-48340682, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:55:12 devstack cinder-volume[94328]: WARNING cinder.quota [None req-e65b2917-4ef0-4111-b2a8-748b2418be20 tempest-TestInstancesWithCinderVolumes-1222968883 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1215677298-48340682 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1215677298-48340682, it is now deprecated. Please use the default quota class for default quota. Aug 27 03:55:12 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-e65b2917-4ef0-4111-b2a8-748b2418be20 tempest-TestInstancesWithCinderVolumes-1222968883 None] Created reservations ['9920e67a-bf71-425a-ab9b-dee8e7a2bca6', '091b694a-7c31-4b47-968f-bf4bebf4dcba', 'cc7e07ff-a21e-4c1f-9e8d-8068fb0c4b2f', 'a4340691-9bbe-4391-a6c7-bb2a867a5402'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:55:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e65b2917-4ef0-4111-b2a8-748b2418be20 tempest-TestInstancesWithCinderVolumes-1222968883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:55:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e65b2917-4ef0-4111-b2a8-748b2418be20 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:55:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e65b2917-4ef0-4111-b2a8-748b2418be20 tempest-TestInstancesWithCinderVolumes-1222968883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:55:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e65b2917-4ef0-4111-b2a8-748b2418be20 tempest-TestInstancesWithCinderVolumes-1222968883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:55:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e65b2917-4ef0-4111-b2a8-748b2418be20 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:55:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e65b2917-4ef0-4111-b2a8-748b2418be20 tempest-TestInstancesWithCinderVolumes-1222968883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:55:12 devstack sudo[112738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:55:12 devstack sudo[112738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:55:13 devstack sudo[112738]: pam_unix(sudo:session): session closed for user root Aug 27 03:55:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e65b2917-4ef0-4111-b2a8-748b2418be20 tempest-TestInstancesWithCinderVolumes-1222968883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.378s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:55:13 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-e65b2917-4ef0-4111-b2a8-748b2418be20 tempest-TestInstancesWithCinderVolumes-1222968883 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:55:13 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e65b2917-4ef0-4111-b2a8-748b2418be20 tempest-TestInstancesWithCinderVolumes-1222968883 None] Deleted volume successfully. Aug 27 03:55:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e65b2917-4ef0-4111-b2a8-748b2418be20 tempest-TestInstancesWithCinderVolumes-1222968883 None] Lock "cinder-d853492f-72e4-4e4c-a1fb-ab42e5dedc78-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:55:13 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-b085da15-387f-46c2-a0ce-2f80125d5509 req-27f5efb6-1a2b-40cc-a3b0-833c5111807d tempest-TestShelveInstance-1534771150 None] Terminate volume connection completed successfully. Aug 27 03:55:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-b085da15-387f-46c2-a0ce-2f80125d5509 req-27f5efb6-1a2b-40cc-a3b0-833c5111807d tempest-TestShelveInstance-1534771150 None] Deleting attachment 3edec19f-4935-4f4f-8ffd-838400cc7bc3. {{(pid=94328) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 27 03:55:14 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:55:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:55:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:55:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:55:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:55:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:55:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:55:14 devstack sudo[112757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:55:14 devstack sudo[112757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:55:15 devstack sudo[112757]: pam_unix(sudo:session): session closed for user root Aug 27 03:55:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.289s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:55:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:55:15 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager._thread_info {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:55:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread count: 28 {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 03:55:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread info: [<_MainThread(MainThread, started 134250325188736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 03:55:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-812b82cc-72c1-4fa9-9dd4-3588ddac263d req-98941987-dd26-4486-bfeb-f1b4bd13df78 tempest-TestShelveInstance-1534771150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:55:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-812b82cc-72c1-4fa9-9dd4-3588ddac263d req-98941987-dd26-4486-bfeb-f1b4bd13df78 tempest-TestShelveInstance-1534771150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:55:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-812b82cc-72c1-4fa9-9dd4-3588ddac263d req-98941987-dd26-4486-bfeb-f1b4bd13df78 tempest-TestShelveInstance-1534771150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:55:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-812b82cc-72c1-4fa9-9dd4-3588ddac263d req-98941987-dd26-4486-bfeb-f1b4bd13df78 tempest-TestShelveInstance-1534771150 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac', 'name': 'volume-806a0689-6f35-40e4-8d39-14109a882378', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0ebeaf1-7b99-433c-9819-6d876044b463', 'enforce_multipath': True} {{(pid=94328) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 27 03:55:15 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-812b82cc-72c1-4fa9-9dd4-3588ddac263d req-98941987-dd26-4486-bfeb-f1b4bd13df78 tempest-TestShelveInstance-1534771150 None] attachment_update completed successfully. Aug 27 03:55:25 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=34,cinder:UPDATE=31,cinder:INSERT=7,cinder:DELETE=3 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:55:25 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=43,cinder:UPDATE=26,cinder:INSERT=5 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:55:48 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-df10226e-9ccc-4816-841d-7ac63ad8a74b req-6a2b7c38-a054-4841-aba7-a8281e05ae52 tempest-TestShelveInstance-1534771150 None] Terminate volume connection completed successfully. Aug 27 03:55:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [req-df10226e-9ccc-4816-841d-7ac63ad8a74b req-6a2b7c38-a054-4841-aba7-a8281e05ae52 tempest-TestShelveInstance-1534771150 None] Deleting attachment f0ebeaf1-7b99-433c-9819-6d876044b463. {{(pid=94328) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 27 03:55:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-df10226e-9ccc-4816-841d-7ac63ad8a74b req-07d2fae1-fca3-4029-a9c1-cfd93ea97ba0 tempest-TestShelveInstance-1534771150 None] Acquiring lock "cinder-806a0689-6f35-40e4-8d39-14109a882378-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:55:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-df10226e-9ccc-4816-841d-7ac63ad8a74b req-07d2fae1-fca3-4029-a9c1-cfd93ea97ba0 tempest-TestShelveInstance-1534771150 None] Lock "cinder-806a0689-6f35-40e4-8d39-14109a882378-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:55:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-df10226e-9ccc-4816-841d-7ac63ad8a74b req-07d2fae1-fca3-4029-a9c1-cfd93ea97ba0 tempest-TestShelveInstance-1534771150 None] Acquiring lock "cinder-quobyte-806a0689-6f35-40e4-8d39-14109a882378" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:55:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-df10226e-9ccc-4816-841d-7ac63ad8a74b req-07d2fae1-fca3-4029-a9c1-cfd93ea97ba0 tempest-TestShelveInstance-1534771150 None] Lock "cinder-quobyte-806a0689-6f35-40e4-8d39-14109a882378" acquired by "delete_volume" :: waited 0.019s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:55:48 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63323d3-af57-484a-968e-926479f49fa3]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:55:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-df10226e-9ccc-4816-841d-7ac63ad8a74b req-07d2fae1-fca3-4029-a9c1-cfd93ea97ba0 tempest-TestShelveInstance-1534771150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-806a0689-6f35-40e4-8d39-14109a882378 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:55:48 devstack sudo[113353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-806a0689-6f35-40e4-8d39-14109a882378 Aug 27 03:55:48 devstack sudo[113353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:55:48 devstack sudo[113353]: pam_unix(sudo:session): session closed for user root Aug 27 03:55:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-df10226e-9ccc-4816-841d-7ac63ad8a74b req-07d2fae1-fca3-4029-a9c1-cfd93ea97ba0 tempest-TestShelveInstance-1534771150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-806a0689-6f35-40e4-8d39-14109a882378" returned: 0 in 0.411s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:55:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-df10226e-9ccc-4816-841d-7ac63ad8a74b req-07d2fae1-fca3-4029-a9c1-cfd93ea97ba0 tempest-TestShelveInstance-1534771150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-806a0689-6f35-40e4-8d39-14109a882378 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:55:48 devstack sudo[113358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-806a0689-6f35-40e4-8d39-14109a882378 Aug 27 03:55:48 devstack sudo[113358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:55:49 devstack sudo[113358]: pam_unix(sudo:session): session closed for user root Aug 27 03:55:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-df10226e-9ccc-4816-841d-7ac63ad8a74b req-07d2fae1-fca3-4029-a9c1-cfd93ea97ba0 tempest-TestShelveInstance-1534771150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-806a0689-6f35-40e4-8d39-14109a882378" returned: 0 in 0.286s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:55:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-df10226e-9ccc-4816-841d-7ac63ad8a74b req-07d2fae1-fca3-4029-a9c1-cfd93ea97ba0 tempest-TestShelveInstance-1534771150 None] Lock "cinder-quobyte-806a0689-6f35-40e4-8d39-14109a882378" released by "delete_volume" :: held 0.750s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:55:49 devstack cinder-volume[94328]: DEBUG cinder.quota [req-df10226e-9ccc-4816-841d-7ac63ad8a74b req-07d2fae1-fca3-4029-a9c1-cfd93ea97ba0 tempest-TestShelveInstance-1534771150 None] Created reservations ['4ed9a440-4c51-4b0b-80e5-129419fd4b4b', '7dbc49dc-9f7c-461b-a0f1-e570571f2535', '229f71f8-ae0f-4380-a75e-1cba6175019e', 'f18e7390-3b2c-4182-bafe-640186103089'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:55:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-df10226e-9ccc-4816-841d-7ac63ad8a74b req-07d2fae1-fca3-4029-a9c1-cfd93ea97ba0 tempest-TestShelveInstance-1534771150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:55:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-df10226e-9ccc-4816-841d-7ac63ad8a74b req-07d2fae1-fca3-4029-a9c1-cfd93ea97ba0 tempest-TestShelveInstance-1534771150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:55:49 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [req-df10226e-9ccc-4816-841d-7ac63ad8a74b req-07d2fae1-fca3-4029-a9c1-cfd93ea97ba0 tempest-TestShelveInstance-1534771150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:55:49 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [req-df10226e-9ccc-4816-841d-7ac63ad8a74b req-07d2fae1-fca3-4029-a9c1-cfd93ea97ba0 tempest-TestShelveInstance-1534771150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:55:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [req-df10226e-9ccc-4816-841d-7ac63ad8a74b req-07d2fae1-fca3-4029-a9c1-cfd93ea97ba0 tempest-TestShelveInstance-1534771150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:55:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-df10226e-9ccc-4816-841d-7ac63ad8a74b req-07d2fae1-fca3-4029-a9c1-cfd93ea97ba0 tempest-TestShelveInstance-1534771150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:55:49 devstack sudo[113361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:55:49 devstack sudo[113361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:55:49 devstack sudo[113361]: pam_unix(sudo:session): session closed for user root Aug 27 03:55:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [req-df10226e-9ccc-4816-841d-7ac63ad8a74b req-07d2fae1-fca3-4029-a9c1-cfd93ea97ba0 tempest-TestShelveInstance-1534771150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.321s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:55:49 devstack cinder-volume[94328]: DEBUG cinder.manager [req-df10226e-9ccc-4816-841d-7ac63ad8a74b req-07d2fae1-fca3-4029-a9c1-cfd93ea97ba0 tempest-TestShelveInstance-1534771150 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:55:49 devstack cinder-volume[94328]: INFO cinder.volume.manager [req-df10226e-9ccc-4816-841d-7ac63ad8a74b req-07d2fae1-fca3-4029-a9c1-cfd93ea97ba0 tempest-TestShelveInstance-1534771150 None] Deleted volume successfully. Aug 27 03:55:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [req-df10226e-9ccc-4816-841d-7ac63ad8a74b req-07d2fae1-fca3-4029-a9c1-cfd93ea97ba0 tempest-TestShelveInstance-1534771150 None] Lock "cinder-806a0689-6f35-40e4-8d39-14109a882378-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:55:51 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:55:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Flow 'volume_create_manager' (8fa9b40a-6a7a-411b-b828-afab5b2e8125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:55:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9809cfe-fe62-481f-ba2e-102c7d522c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:55:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9809cfe-fe62-481f-ba2e-102c7d522c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1463963301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46d21aa-0f51-440e-b2ab-460291368976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66fc9a98c38f473fa56a04a28690b730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:55:51Z,use_quota=True,user_id='10a9a41bb96141c4926a4c723186391c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:55:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54748d05-c9b3-48d2-9835-b517eb6f12f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:55:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54748d05-c9b3-48d2-9835-b517eb6f12f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:55:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a9f4fb-615e-4a1a-84c3-fdc5aae3be76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:55:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a9f4fb-615e-4a1a-84c3-fdc5aae3be76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e46d21aa-0f51-440e-b2ab-460291368976', 'volume_name': 'volume-e46d21aa-0f51-440e-b2ab-460291368976', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:55:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c750225-da68-45e1-87e3-6d3e1362d9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:55:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c750225-da68-45e1-87e3-6d3e1362d9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:55:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbb22525-48a8-4dd4-a0f8-b5606dbef500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:55:51 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Volume e46d21aa-0f51-440e-b2ab-460291368976: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e46d21aa-0f51-440e-b2ab-460291368976', 'volume_size': 1} Aug 27 03:55:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:55:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:55:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1463963301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46d21aa-0f51-440e-b2ab-460291368976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66fc9a98c38f473fa56a04a28690b730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:55:51Z,use_quota=True,user_id='10a9a41bb96141c4926a4c723186391c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:55:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Creating volume e46d21aa-0f51-440e-b2ab-460291368976 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:55:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:55:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:55:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:55:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:55:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:55:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:55:51 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:55:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:55:51 devstack sudo[113365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976 1073741824 Aug 27 03:55:51 devstack sudo[113365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:55:52 devstack sudo[113365]: pam_unix(sudo:session): session closed for user root Aug 27 03:55:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976 1073741824" returned: 0 in 0.464s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:55:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:55:52 devstack sudo[113371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976 Aug 27 03:55:52 devstack sudo[113371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:55:52 devstack sudo[113371]: pam_unix(sudo:session): session closed for user root Aug 27 03:55:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976" returned: 0 in 0.293s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:55:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:55:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:55:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbb22525-48a8-4dd4-a0f8-b5606dbef500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e46d21aa-0f51-440e-b2ab-460291368976', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:55:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5507b4f-ba09-43f8-98be-f928569695d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:55:52 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Volume volume-e46d21aa-0f51-440e-b2ab-460291368976 (e46d21aa-0f51-440e-b2ab-460291368976): created successfully Aug 27 03:55:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5507b4f-ba09-43f8-98be-f928569695d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:55:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Flow 'volume_create_manager' (8fa9b40a-6a7a-411b-b828-afab5b2e8125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:55:52 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e4ac0349-0943-4396-9175-f58efb323007 tempest-TestImageHashVerification-452945317 None] Created volume successfully. Aug 27 03:55:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-60866f3e-62d4-48e5-af97-eb19ce7144ff tempest-TestImageHashVerification-452945317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:55:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-60866f3e-62d4-48e5-af97-eb19ce7144ff tempest-TestImageHashVerification-452945317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:55:54 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e11582-be39-4b38-88bd-f13ed425e341]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:55:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-60866f3e-62d4-48e5-af97-eb19ce7144ff tempest-TestImageHashVerification-452945317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:55:54 devstack sudo[113376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976 Aug 27 03:55:54 devstack sudo[113376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:55:54 devstack sudo[113376]: pam_unix(sudo:session): session closed for user root Aug 27 03:55:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-60866f3e-62d4-48e5-af97-eb19ce7144ff tempest-TestImageHashVerification-452945317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976" returned: 0 in 0.353s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:55:54 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3cde0b-8a9d-4792-93b1-821f193172bf]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:55:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-60866f3e-62d4-48e5-af97-eb19ce7144ff tempest-TestImageHashVerification-452945317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:55:54 devstack sudo[113381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976 Aug 27 03:55:54 devstack sudo[113381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:55:55 devstack sudo[113381]: pam_unix(sudo:session): session closed for user root Aug 27 03:55:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-60866f3e-62d4-48e5-af97-eb19ce7144ff tempest-TestImageHashVerification-452945317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976" returned: 0 in 0.410s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:55:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-60866f3e-62d4-48e5-af97-eb19ce7144ff tempest-TestImageHashVerification-452945317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976 /opt/stack/data/cinder/conversion/e46d21aa-0f51-440e-b2ab-460291368976.temp_image.3f264b82-fdd0-43f6-9e14-f79b7b97548atampcf0o.img {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:55:55 devstack sudo[113387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976 /opt/stack/data/cinder/conversion/e46d21aa-0f51-440e-b2ab-460291368976.temp_image.3f264b82-fdd0-43f6-9e14-f79b7b97548atampcf0o.img Aug 27 03:55:55 devstack sudo[113387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:55:59 devstack sudo[113387]: pam_unix(sudo:session): session closed for user root Aug 27 03:55:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-60866f3e-62d4-48e5-af97-eb19ce7144ff tempest-TestImageHashVerification-452945317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976 /opt/stack/data/cinder/conversion/e46d21aa-0f51-440e-b2ab-460291368976.temp_image.3f264b82-fdd0-43f6-9e14-f79b7b97548atampcf0o.img" returned: 0 in 4.372s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:55:59 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[7736aef1-4f83-4e34-b9ef-35a3b830930c]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:55:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-60866f3e-62d4-48e5-af97-eb19ce7144ff tempest-TestImageHashVerification-452945317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:55:59 devstack sudo[113400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976 Aug 27 03:55:59 devstack sudo[113400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:00 devstack sudo[113400]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-60866f3e-62d4-48e5-af97-eb19ce7144ff tempest-TestImageHashVerification-452945317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976" returned: 0 in 0.581s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:00 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-60866f3e-62d4-48e5-af97-eb19ce7144ff tempest-TestImageHashVerification-452945317 None] Image conversion details: src /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976, size 1024.00 MB, duration 4.37 sec, destination /opt/stack/data/cinder/conversion/e46d21aa-0f51-440e-b2ab-460291368976.temp_image.3f264b82-fdd0-43f6-9e14-f79b7b97548atampcf0o.img {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:56:00 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-60866f3e-62d4-48e5-af97-eb19ce7144ff tempest-TestImageHashVerification-452945317 None] Converted 1024.00 MB image at 234.16 MB/s Aug 27 03:56:00 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-60866f3e-62d4-48e5-af97-eb19ce7144ff tempest-TestImageHashVerification-452945317 None] 3f264b82-fdd0-43f6-9e14-f79b7b97548a was raw, no need to convert to raw {{(pid=94328) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 27 03:56:06 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:56:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Flow 'volume_create_manager' (a4f810ca-a08e-4828-aa7a-7763b957b159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a41f37-d377-4be8-a99c-6286e253a9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a41f37-d377-4be8-a99c-6286e253a9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-139402805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7644c8ea-d1ee-4a08-a4a2-db81db83df86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea509f381ba74c0e8b0b7e431005529b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:06Z,use_quota=True,user_id='2c02dd95d2e347c2a0d4513befd29801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18462bc4-1dda-42fc-9d98-d8742d920d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18462bc4-1dda-42fc-9d98-d8742d920d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c76b73-d1c9-407c-a600-97c6b3127d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c76b73-d1c9-407c-a600-97c6b3127d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7644c8ea-d1ee-4a08-a4a2-db81db83df86', 'volume_name': 'volume-7644c8ea-d1ee-4a08-a4a2-db81db83df86', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a348be04-2ad4-4356-aecf-6324942394bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a348be04-2ad4-4356-aecf-6324942394bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d294b7-6bba-4197-b0c0-ea866da59700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:06 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Volume 7644c8ea-d1ee-4a08-a4a2-db81db83df86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7644c8ea-d1ee-4a08-a4a2-db81db83df86', 'volume_size': 1} Aug 27 03:56:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:14 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:56:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:14 devstack sudo[113411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:56:14 devstack sudo[113411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:15 devstack sudo[113411]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.248s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:56:15 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager._thread_info {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:56:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread count: 28 {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 03:56:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread info: [<_MainThread(MainThread, started 134250325188736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 03:56:16 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=15,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:56:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-60866f3e-62d4-48e5-af97-eb19ce7144ff tempest-TestImageHashVerification-452945317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.479s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:19 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-60866f3e-62d4-48e5-af97-eb19ce7144ff tempest-TestImageHashVerification-452945317 None] Uploaded volume to glance image-id: 3f264b82-fdd0-43f6-9e14-f79b7b97548a. {{(pid=94328) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 27 03:56:19 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:UPDATE=15,cinder:SELECT=7,cinder:INSERT=3,cinder:DELETE=1 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:56:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.573s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-139402805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7644c8ea-d1ee-4a08-a4a2-db81db83df86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea509f381ba74c0e8b0b7e431005529b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:06Z,use_quota=True,user_id='2c02dd95d2e347c2a0d4513befd29801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:56:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Creating volume 7644c8ea-d1ee-4a08-a4a2-db81db83df86 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:56:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:56:19 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:56:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7644c8ea-d1ee-4a08-a4a2-db81db83df86 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:19 devstack sudo[113450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7644c8ea-d1ee-4a08-a4a2-db81db83df86 1073741824 Aug 27 03:56:19 devstack sudo[113450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:19 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-60866f3e-62d4-48e5-af97-eb19ce7144ff tempest-TestImageHashVerification-452945317 None] Copy volume to image completed successfully. Aug 27 03:56:20 devstack sudo[113450]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7644c8ea-d1ee-4a08-a4a2-db81db83df86 1073741824" returned: 0 in 0.435s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7644c8ea-d1ee-4a08-a4a2-db81db83df86 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:20 devstack sudo[113456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7644c8ea-d1ee-4a08-a4a2-db81db83df86 Aug 27 03:56:20 devstack sudo[113456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:20 devstack sudo[113456]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7644c8ea-d1ee-4a08-a4a2-db81db83df86" returned: 0 in 0.268s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:56:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d294b7-6bba-4197-b0c0-ea866da59700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7644c8ea-d1ee-4a08-a4a2-db81db83df86', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a831f2-4662-4648-8ccb-80da60579b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:20 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Volume volume-7644c8ea-d1ee-4a08-a4a2-db81db83df86 (7644c8ea-d1ee-4a08-a4a2-db81db83df86): created successfully Aug 27 03:56:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a831f2-4662-4648-8ccb-80da60579b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Flow 'volume_create_manager' (a4f810ca-a08e-4828-aa7a-7763b957b159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:20 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-7c33df9f-911a-4034-9f75-2c11f698b565 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Created volume successfully. Aug 27 03:56:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a55c14a2-dd35-4414-a460-a18e39e574f7 tempest-TestImageHashVerification-452945317 None] Acquiring lock "cinder-e46d21aa-0f51-440e-b2ab-460291368976-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a55c14a2-dd35-4414-a460-a18e39e574f7 tempest-TestImageHashVerification-452945317 None] Lock "cinder-e46d21aa-0f51-440e-b2ab-460291368976-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a55c14a2-dd35-4414-a460-a18e39e574f7 tempest-TestImageHashVerification-452945317 None] Acquiring lock "cinder-quobyte-e46d21aa-0f51-440e-b2ab-460291368976" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a55c14a2-dd35-4414-a460-a18e39e574f7 tempest-TestImageHashVerification-452945317 None] Lock "cinder-quobyte-e46d21aa-0f51-440e-b2ab-460291368976" acquired by "delete_volume" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93a56ff-4a49-4590-b314-3fb76d9c69a4]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a55c14a2-dd35-4414-a460-a18e39e574f7 tempest-TestImageHashVerification-452945317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:21 devstack sudo[113461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976 Aug 27 03:56:21 devstack sudo[113461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:21 devstack sudo[113461]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a55c14a2-dd35-4414-a460-a18e39e574f7 tempest-TestImageHashVerification-452945317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976" returned: 0 in 0.394s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a55c14a2-dd35-4414-a460-a18e39e574f7 tempest-TestImageHashVerification-452945317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:21 devstack sudo[113466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976 Aug 27 03:56:21 devstack sudo[113466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Flow 'volume_create_manager' (22ee3b20-7047-4acb-950a-1d9b072edbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd4c774-8af7-4573-9814-121c0e4e0f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd4c774-8af7-4573-9814-121c0e4e0f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1045138237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=888eebbb-e5ec-4619-8a9c-c1e66c6b0f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea509f381ba74c0e8b0b7e431005529b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:22Z,use_quota=True,user_id='2c02dd95d2e347c2a0d4513befd29801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3009c71-6f0e-4705-bea3-74c7d14b1530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3009c71-6f0e-4705-bea3-74c7d14b1530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce815f3c-ba2f-4a31-81b6-e0234a4f9fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce815f3c-ba2f-4a31-81b6-e0234a4f9fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '888eebbb-e5ec-4619-8a9c-c1e66c6b0f56', 'volume_name': 'volume-888eebbb-e5ec-4619-8a9c-c1e66c6b0f56', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:21 devstack sudo[113466]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33259bf5-6b5e-450a-a77c-95ff013805c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33259bf5-6b5e-450a-a77c-95ff013805c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5ac50c-f179-40f1-926c-4d16e0d1bd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:21 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Volume 888eebbb-e5ec-4619-8a9c-c1e66c6b0f56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-888eebbb-e5ec-4619-8a9c-c1e66c6b0f56', 'volume_size': 1} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1045138237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=888eebbb-e5ec-4619-8a9c-c1e66c6b0f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea509f381ba74c0e8b0b7e431005529b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:22Z,use_quota=True,user_id='2c02dd95d2e347c2a0d4513befd29801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Creating volume 888eebbb-e5ec-4619-8a9c-c1e66c6b0f56 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:56:21 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-888eebbb-e5ec-4619-8a9c-c1e66c6b0f56 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a55c14a2-dd35-4414-a460-a18e39e574f7 tempest-TestImageHashVerification-452945317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e46d21aa-0f51-440e-b2ab-460291368976" returned: 0 in 0.304s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:21 devstack sudo[113469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-888eebbb-e5ec-4619-8a9c-c1e66c6b0f56 1073741824 Aug 27 03:56:21 devstack sudo[113469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a55c14a2-dd35-4414-a460-a18e39e574f7 tempest-TestImageHashVerification-452945317 None] Lock "cinder-quobyte-e46d21aa-0f51-440e-b2ab-460291368976" released by "delete_volume" :: held 0.749s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-a55c14a2-dd35-4414-a460-a18e39e574f7 tempest-TestImageHashVerification-452945317 None] Created reservations ['cc48274b-bf40-47aa-9f07-ca8f94ebe4a4', '175cf253-b36c-4c22-a9c1-22fee68d7a6c', '6edc9e9d-1096-4482-be0f-21a3ec646b8e', 'ed366ec5-bc35-4446-9d10-efa8218c516e'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a55c14a2-dd35-4414-a460-a18e39e574f7 tempest-TestImageHashVerification-452945317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a55c14a2-dd35-4414-a460-a18e39e574f7 tempest-TestImageHashVerification-452945317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a55c14a2-dd35-4414-a460-a18e39e574f7 tempest-TestImageHashVerification-452945317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a55c14a2-dd35-4414-a460-a18e39e574f7 tempest-TestImageHashVerification-452945317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a55c14a2-dd35-4414-a460-a18e39e574f7 tempest-TestImageHashVerification-452945317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a55c14a2-dd35-4414-a460-a18e39e574f7 tempest-TestImageHashVerification-452945317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:21 devstack sudo[113471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:56:21 devstack sudo[113471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Flow 'volume_create_manager' (77400df7-8e0e-4fc9-b99c-95221c31899c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf02c55-4766-4c94-bffd-bb3482190966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf02c55-4766-4c94-bffd-bb3482190966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-508611367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40010850-3271-406c-a37f-7c8fd15d33d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea509f381ba74c0e8b0b7e431005529b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:22Z,use_quota=True,user_id='2c02dd95d2e347c2a0d4513befd29801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c4fe84-514d-4cbb-99b4-471384749fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c4fe84-514d-4cbb-99b4-471384749fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16436a7f-d7e9-4244-aaad-20e4cb1c2d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16436a7f-d7e9-4244-aaad-20e4cb1c2d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40010850-3271-406c-a37f-7c8fd15d33d4', 'volume_name': 'volume-40010850-3271-406c-a37f-7c8fd15d33d4', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4982d64-a44b-43ad-af95-4ebef79e8f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4982d64-a44b-43ad-af95-4ebef79e8f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23728ff-aba9-487a-9e8c-87cd547c7eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:22 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Volume 40010850-3271-406c-a37f-7c8fd15d33d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40010850-3271-406c-a37f-7c8fd15d33d4', 'volume_size': 1} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:22 devstack sudo[113471]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a55c14a2-dd35-4414-a460-a18e39e574f7 tempest-TestImageHashVerification-452945317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.292s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-a55c14a2-dd35-4414-a460-a18e39e574f7 tempest-TestImageHashVerification-452945317 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:56:22 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-a55c14a2-dd35-4414-a460-a18e39e574f7 tempest-TestImageHashVerification-452945317 None] Deleted volume successfully. Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a55c14a2-dd35-4414-a460-a18e39e574f7 tempest-TestImageHashVerification-452945317 None] Lock "cinder-e46d21aa-0f51-440e-b2ab-460291368976-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:22 devstack sudo[113469]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-888eebbb-e5ec-4619-8a9c-c1e66c6b0f56 1073741824" returned: 0 in 0.569s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-888eebbb-e5ec-4619-8a9c-c1e66c6b0f56 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:22 devstack sudo[113478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-888eebbb-e5ec-4619-8a9c-c1e66c6b0f56 Aug 27 03:56:22 devstack sudo[113478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Flow 'volume_create_manager' (9f50ca5f-8711-4da7-8d78-c52df543ee87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced82dba-4477-423c-9ef0-e5f577b1ef09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced82dba-4477-423c-9ef0-e5f577b1ef09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1122310976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fe1c93-024f-49f6-aef6-0ef35c20bd78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea509f381ba74c0e8b0b7e431005529b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:23Z,use_quota=True,user_id='2c02dd95d2e347c2a0d4513befd29801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1dbd104-7e78-4878-8830-71f2ccf66df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1dbd104-7e78-4878-8830-71f2ccf66df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f211a87-aa0c-4a64-afc0-f2387ff14be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f211a87-aa0c-4a64-afc0-f2387ff14be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23fe1c93-024f-49f6-aef6-0ef35c20bd78', 'volume_name': 'volume-23fe1c93-024f-49f6-aef6-0ef35c20bd78', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b6638b-c28f-4707-a8dd-670c5cb12899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b6638b-c28f-4707-a8dd-670c5cb12899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e603434-3bac-47c7-8a75-750591ab2cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:22 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Volume 23fe1c93-024f-49f6-aef6-0ef35c20bd78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23fe1c93-024f-49f6-aef6-0ef35c20bd78', 'volume_size': 1} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:22 devstack sudo[113478]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-888eebbb-e5ec-4619-8a9c-c1e66c6b0f56" returned: 0 in 0.342s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.542s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-508611367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40010850-3271-406c-a37f-7c8fd15d33d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea509f381ba74c0e8b0b7e431005529b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:22Z,use_quota=True,user_id='2c02dd95d2e347c2a0d4513befd29801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Creating volume 40010850-3271-406c-a37f-7c8fd15d33d4 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:56:22 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-40010850-3271-406c-a37f-7c8fd15d33d4 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5ac50c-f179-40f1-926c-4d16e0d1bd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-888eebbb-e5ec-4619-8a9c-c1e66c6b0f56', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (932cd6a3-183a-4b66-aad0-d6427338c92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:22 devstack sudo[113481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-40010850-3271-406c-a37f-7c8fd15d33d4 1073741824 Aug 27 03:56:22 devstack sudo[113481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:22 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Volume volume-888eebbb-e5ec-4619-8a9c-c1e66c6b0f56 (888eebbb-e5ec-4619-8a9c-c1e66c6b0f56): created successfully Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (932cd6a3-183a-4b66-aad0-d6427338c92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:22 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Flow 'volume_create_manager' (22ee3b20-7047-4acb-950a-1d9b072edbc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:22 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-92b0c690-26ca-42f5-ae7f-6b6509b782d6 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Created volume successfully. Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Flow 'volume_create_manager' (96416e3e-5356-4cca-9dca-b93a8894e3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8771687-b316-4c75-82e6-eb9d6d71376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8771687-b316-4c75-82e6-eb9d6d71376e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-463297568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914b50cb-cb05-4e19-b1d3-a0b41268de0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea509f381ba74c0e8b0b7e431005529b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:23Z,use_quota=True,user_id='2c02dd95d2e347c2a0d4513befd29801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07df4102-4d7c-4662-9f20-47240ccd087a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07df4102-4d7c-4662-9f20-47240ccd087a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7309da55-72d3-4b20-929b-76c247e27f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7309da55-72d3-4b20-929b-76c247e27f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '914b50cb-cb05-4e19-b1d3-a0b41268de0b', 'volume_name': 'volume-914b50cb-cb05-4e19-b1d3-a0b41268de0b', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbdbbc4-f4a6-4bab-99c9-2daa70884e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbdbbc4-f4a6-4bab-99c9-2daa70884e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544ae56b-f8e7-48e1-b64a-5617dfd33541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:23 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Volume 914b50cb-cb05-4e19-b1d3-a0b41268de0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-914b50cb-cb05-4e19-b1d3-a0b41268de0b', 'volume_size': 1} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:23 devstack sudo[113481]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-40010850-3271-406c-a37f-7c8fd15d33d4 1073741824" returned: 0 in 0.665s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-40010850-3271-406c-a37f-7c8fd15d33d4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:23 devstack sudo[113489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-40010850-3271-406c-a37f-7c8fd15d33d4 Aug 27 03:56:23 devstack sudo[113489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Flow 'volume_create_manager' (e604bfa6-cb4b-4a59-98a0-36df30ee3353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93693360-5bc6-4c65-82a7-5bc99f7dd6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93693360-5bc6-4c65-82a7-5bc99f7dd6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1439293518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d513fde7-3427-4eaf-a002-96cfacb2a2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea509f381ba74c0e8b0b7e431005529b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:23Z,use_quota=True,user_id='2c02dd95d2e347c2a0d4513befd29801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380d2ede-afb4-4d56-9540-b636fea07bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380d2ede-afb4-4d56-9540-b636fea07bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36d4b2e-909a-4e93-8b41-248543be7d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36d4b2e-909a-4e93-8b41-248543be7d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd513fde7-3427-4eaf-a002-96cfacb2a2c0', 'volume_name': 'volume-d513fde7-3427-4eaf-a002-96cfacb2a2c0', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318e7cc9-7c5e-479d-8854-ba39a23da910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318e7cc9-7c5e-479d-8854-ba39a23da910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddd22a4-4620-4c53-9771-4b7edb57875f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:23 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Volume d513fde7-3427-4eaf-a002-96cfacb2a2c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d513fde7-3427-4eaf-a002-96cfacb2a2c0', 'volume_size': 1} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:23 devstack sudo[113489]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-40010850-3271-406c-a37f-7c8fd15d33d4" returned: 0 in 0.272s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.031s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1122310976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fe1c93-024f-49f6-aef6-0ef35c20bd78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea509f381ba74c0e8b0b7e431005529b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:23Z,use_quota=True,user_id='2c02dd95d2e347c2a0d4513befd29801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Creating volume 23fe1c93-024f-49f6-aef6-0ef35c20bd78 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:56:23 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-23fe1c93-024f-49f6-aef6-0ef35c20bd78 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f23728ff-aba9-487a-9e8c-87cd547c7eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40010850-3271-406c-a37f-7c8fd15d33d4', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40481bc1-3410-4ede-9f5b-8ea3a3071e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:23 devstack sudo[113492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-23fe1c93-024f-49f6-aef6-0ef35c20bd78 1073741824 Aug 27 03:56:23 devstack sudo[113492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:23 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Volume volume-40010850-3271-406c-a37f-7c8fd15d33d4 (40010850-3271-406c-a37f-7c8fd15d33d4): created successfully Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40481bc1-3410-4ede-9f5b-8ea3a3071e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:23 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Flow 'volume_create_manager' (77400df7-8e0e-4fc9-b99c-95221c31899c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:23 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-768d2db6-6c2b-4578-9669-2c2fc7dabbf7 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Created volume successfully. Aug 27 03:56:24 devstack sudo[113492]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-23fe1c93-024f-49f6-aef6-0ef35c20bd78 1073741824" returned: 0 in 0.474s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-23fe1c93-024f-49f6-aef6-0ef35c20bd78 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:24 devstack sudo[113499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-23fe1c93-024f-49f6-aef6-0ef35c20bd78 Aug 27 03:56:24 devstack sudo[113499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:24 devstack sudo[113499]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-23fe1c93-024f-49f6-aef6-0ef35c20bd78" returned: 0 in 0.255s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:56:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.368s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-463297568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914b50cb-cb05-4e19-b1d3-a0b41268de0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea509f381ba74c0e8b0b7e431005529b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:23Z,use_quota=True,user_id='2c02dd95d2e347c2a0d4513befd29801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:56:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Creating volume 914b50cb-cb05-4e19-b1d3-a0b41268de0b {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:56:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:56:24 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:56:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-914b50cb-cb05-4e19-b1d3-a0b41268de0b 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e603434-3bac-47c7-8a75-750591ab2cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23fe1c93-024f-49f6-aef6-0ef35c20bd78', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:24 devstack sudo[113502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-914b50cb-cb05-4e19-b1d3-a0b41268de0b 1073741824 Aug 27 03:56:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (456c4429-f153-4549-85d6-0ec719b7c1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:24 devstack sudo[113502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:24 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Volume volume-23fe1c93-024f-49f6-aef6-0ef35c20bd78 (23fe1c93-024f-49f6-aef6-0ef35c20bd78): created successfully Aug 27 03:56:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (456c4429-f153-4549-85d6-0ec719b7c1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Flow 'volume_create_manager' (9f50ca5f-8711-4da7-8d78-c52df543ee87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:24 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-57df6d19-3df8-4ae1-8e0c-53707a0e819e tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Created volume successfully. Aug 27 03:56:24 devstack sudo[113502]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-914b50cb-cb05-4e19-b1d3-a0b41268de0b 1073741824" returned: 0 in 0.476s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-914b50cb-cb05-4e19-b1d3-a0b41268de0b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:25 devstack sudo[113507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-914b50cb-cb05-4e19-b1d3-a0b41268de0b Aug 27 03:56:25 devstack sudo[113507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:25 devstack sudo[113507]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-914b50cb-cb05-4e19-b1d3-a0b41268de0b" returned: 0 in 0.240s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:25 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:56:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.644s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:25 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1439293518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d513fde7-3427-4eaf-a002-96cfacb2a2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea509f381ba74c0e8b0b7e431005529b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:23Z,use_quota=True,user_id='2c02dd95d2e347c2a0d4513befd29801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:56:25 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Creating volume d513fde7-3427-4eaf-a002-96cfacb2a2c0 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:56:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:25 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:25 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:25 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:56:25 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:56:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d513fde7-3427-4eaf-a002-96cfacb2a2c0 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544ae56b-f8e7-48e1-b64a-5617dfd33541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-914b50cb-cb05-4e19-b1d3-a0b41268de0b', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265791f5-38b3-40d8-b615-8d79bf2d2ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:25 devstack sudo[113510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d513fde7-3427-4eaf-a002-96cfacb2a2c0 1073741824 Aug 27 03:56:25 devstack sudo[113510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:25 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Volume volume-914b50cb-cb05-4e19-b1d3-a0b41268de0b (914b50cb-cb05-4e19-b1d3-a0b41268de0b): created successfully Aug 27 03:56:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265791f5-38b3-40d8-b615-8d79bf2d2ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Flow 'volume_create_manager' (96416e3e-5356-4cca-9dca-b93a8894e3a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:25 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f2d6a373-f0b6-4c9f-a8ef-6df5a6cd4f91 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Created volume successfully. Aug 27 03:56:25 devstack sudo[113510]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d513fde7-3427-4eaf-a002-96cfacb2a2c0 1073741824" returned: 0 in 0.445s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d513fde7-3427-4eaf-a002-96cfacb2a2c0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:25 devstack sudo[113522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d513fde7-3427-4eaf-a002-96cfacb2a2c0 Aug 27 03:56:25 devstack sudo[113522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:26 devstack sudo[113522]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d513fde7-3427-4eaf-a002-96cfacb2a2c0" returned: 0 in 0.315s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:26 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:56:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddd22a4-4620-4c53-9771-4b7edb57875f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d513fde7-3427-4eaf-a002-96cfacb2a2c0', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98778501-e9f6-4cf5-8747-f26243319fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:26 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Volume volume-d513fde7-3427-4eaf-a002-96cfacb2a2c0 (d513fde7-3427-4eaf-a002-96cfacb2a2c0): created successfully Aug 27 03:56:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98778501-e9f6-4cf5-8747-f26243319fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Flow 'volume_create_manager' (e604bfa6-cb4b-4a59-98a0-36df30ee3353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:26 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-354d280c-7df5-47ab-998b-197834d4ae1a tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Created volume successfully. Aug 27 03:56:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b239f8a1-06e0-40d9-8351-3e37c9257c4b tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "cinder-d513fde7-3427-4eaf-a002-96cfacb2a2c0-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b239f8a1-06e0-40d9-8351-3e37c9257c4b tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "cinder-d513fde7-3427-4eaf-a002-96cfacb2a2c0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:27 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b239f8a1-06e0-40d9-8351-3e37c9257c4b tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "cinder-quobyte-d513fde7-3427-4eaf-a002-96cfacb2a2c0" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:27 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b239f8a1-06e0-40d9-8351-3e37c9257c4b tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "cinder-quobyte-d513fde7-3427-4eaf-a002-96cfacb2a2c0" acquired by "delete_volume" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:27 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[3075382c-3f1a-4d54-95e7-de67d21cdf7e]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:56:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b239f8a1-06e0-40d9-8351-3e37c9257c4b tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d513fde7-3427-4eaf-a002-96cfacb2a2c0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:27 devstack sudo[113526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d513fde7-3427-4eaf-a002-96cfacb2a2c0 Aug 27 03:56:27 devstack sudo[113526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:27 devstack sudo[113526]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b239f8a1-06e0-40d9-8351-3e37c9257c4b tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d513fde7-3427-4eaf-a002-96cfacb2a2c0" returned: 0 in 0.369s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b239f8a1-06e0-40d9-8351-3e37c9257c4b tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d513fde7-3427-4eaf-a002-96cfacb2a2c0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:27 devstack sudo[113532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d513fde7-3427-4eaf-a002-96cfacb2a2c0 Aug 27 03:56:27 devstack sudo[113532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:27 devstack sudo[113532]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b239f8a1-06e0-40d9-8351-3e37c9257c4b tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d513fde7-3427-4eaf-a002-96cfacb2a2c0" returned: 0 in 0.277s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:27 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b239f8a1-06e0-40d9-8351-3e37c9257c4b tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "cinder-quobyte-d513fde7-3427-4eaf-a002-96cfacb2a2c0" released by "delete_volume" :: held 0.695s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:27 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-b239f8a1-06e0-40d9-8351-3e37c9257c4b tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Created reservations ['987149aa-b83e-4c09-8e71-d7933a2537b0', 'a3b37164-97f4-4dc3-bbb2-555374de4c7b', '8e4d3c41-6198-4d8a-9614-5ca8fcfbb130', 'f06330d6-389f-4990-97cb-eacd9f8026e7'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:56:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b239f8a1-06e0-40d9-8351-3e37c9257c4b tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b239f8a1-06e0-40d9-8351-3e37c9257c4b tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b239f8a1-06e0-40d9-8351-3e37c9257c4b tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b239f8a1-06e0-40d9-8351-3e37c9257c4b tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b239f8a1-06e0-40d9-8351-3e37c9257c4b tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b239f8a1-06e0-40d9-8351-3e37c9257c4b tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:27 devstack sudo[113535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:56:27 devstack sudo[113535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-65b467ec-f4f2-4894-b314-0e4262bd9339 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "cinder-914b50cb-cb05-4e19-b1d3-a0b41268de0b-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:28 devstack sudo[113535]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b239f8a1-06e0-40d9-8351-3e37c9257c4b tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.271s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:28 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-b239f8a1-06e0-40d9-8351-3e37c9257c4b tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:56:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-65b467ec-f4f2-4894-b314-0e4262bd9339 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "cinder-914b50cb-cb05-4e19-b1d3-a0b41268de0b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:28 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-b239f8a1-06e0-40d9-8351-3e37c9257c4b tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Deleted volume successfully. Aug 27 03:56:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b239f8a1-06e0-40d9-8351-3e37c9257c4b tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "cinder-d513fde7-3427-4eaf-a002-96cfacb2a2c0-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-65b467ec-f4f2-4894-b314-0e4262bd9339 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "cinder-quobyte-914b50cb-cb05-4e19-b1d3-a0b41268de0b" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-65b467ec-f4f2-4894-b314-0e4262bd9339 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "cinder-quobyte-914b50cb-cb05-4e19-b1d3-a0b41268de0b" acquired by "delete_volume" :: waited 0.026s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:28 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8931488-edf1-48d1-b463-37b26035a4ee]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:56:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-65b467ec-f4f2-4894-b314-0e4262bd9339 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-914b50cb-cb05-4e19-b1d3-a0b41268de0b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:28 devstack sudo[113539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-914b50cb-cb05-4e19-b1d3-a0b41268de0b Aug 27 03:56:28 devstack sudo[113539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:28 devstack sudo[113539]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-65b467ec-f4f2-4894-b314-0e4262bd9339 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-914b50cb-cb05-4e19-b1d3-a0b41268de0b" returned: 0 in 0.377s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-65b467ec-f4f2-4894-b314-0e4262bd9339 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-914b50cb-cb05-4e19-b1d3-a0b41268de0b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:28 devstack sudo[113544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-914b50cb-cb05-4e19-b1d3-a0b41268de0b Aug 27 03:56:28 devstack sudo[113544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:28 devstack sudo[113544]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-65b467ec-f4f2-4894-b314-0e4262bd9339 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-914b50cb-cb05-4e19-b1d3-a0b41268de0b" returned: 0 in 0.253s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-65b467ec-f4f2-4894-b314-0e4262bd9339 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "cinder-quobyte-914b50cb-cb05-4e19-b1d3-a0b41268de0b" released by "delete_volume" :: held 0.695s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:28 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-65b467ec-f4f2-4894-b314-0e4262bd9339 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Created reservations ['65dd2b7b-cc94-4615-a187-bb3d64d57ad5', 'f964bf15-e9a2-4ac5-a0e2-ac1642fb69da', '71ffed76-7dd7-43db-bab6-e6842e6db38b', 'a2240c4a-a55b-4d5d-9be1-7a527cac68fb'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:56:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-65b467ec-f4f2-4894-b314-0e4262bd9339 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-65b467ec-f4f2-4894-b314-0e4262bd9339 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-65b467ec-f4f2-4894-b314-0e4262bd9339 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-65b467ec-f4f2-4894-b314-0e4262bd9339 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-65b467ec-f4f2-4894-b314-0e4262bd9339 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-65b467ec-f4f2-4894-b314-0e4262bd9339 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:29 devstack sudo[113547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:56:29 devstack sudo[113547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-cf8e40cf-2882-42ba-b7c2-da82cbc10714 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "cinder-23fe1c93-024f-49f6-aef6-0ef35c20bd78-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:29 devstack sudo[113547]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-65b467ec-f4f2-4894-b314-0e4262bd9339 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.282s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:29 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-65b467ec-f4f2-4894-b314-0e4262bd9339 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:56:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-cf8e40cf-2882-42ba-b7c2-da82cbc10714 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "cinder-23fe1c93-024f-49f6-aef6-0ef35c20bd78-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:29 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-65b467ec-f4f2-4894-b314-0e4262bd9339 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Deleted volume successfully. Aug 27 03:56:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-65b467ec-f4f2-4894-b314-0e4262bd9339 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "cinder-914b50cb-cb05-4e19-b1d3-a0b41268de0b-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-cf8e40cf-2882-42ba-b7c2-da82cbc10714 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "cinder-quobyte-23fe1c93-024f-49f6-aef6-0ef35c20bd78" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-cf8e40cf-2882-42ba-b7c2-da82cbc10714 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "cinder-quobyte-23fe1c93-024f-49f6-aef6-0ef35c20bd78" acquired by "delete_volume" :: waited 0.015s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:29 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d47cea2-8d84-46dd-a18b-612d0a2fff48]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:56:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cf8e40cf-2882-42ba-b7c2-da82cbc10714 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-23fe1c93-024f-49f6-aef6-0ef35c20bd78 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:29 devstack sudo[113550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-23fe1c93-024f-49f6-aef6-0ef35c20bd78 Aug 27 03:56:29 devstack sudo[113550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:29 devstack sudo[113550]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cf8e40cf-2882-42ba-b7c2-da82cbc10714 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-23fe1c93-024f-49f6-aef6-0ef35c20bd78" returned: 0 in 0.351s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cf8e40cf-2882-42ba-b7c2-da82cbc10714 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-23fe1c93-024f-49f6-aef6-0ef35c20bd78 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:29 devstack sudo[113555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-23fe1c93-024f-49f6-aef6-0ef35c20bd78 Aug 27 03:56:29 devstack sudo[113555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:30 devstack sudo[113555]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cf8e40cf-2882-42ba-b7c2-da82cbc10714 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-23fe1c93-024f-49f6-aef6-0ef35c20bd78" returned: 0 in 0.245s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-cf8e40cf-2882-42ba-b7c2-da82cbc10714 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "cinder-quobyte-23fe1c93-024f-49f6-aef6-0ef35c20bd78" released by "delete_volume" :: held 0.635s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:30 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-cf8e40cf-2882-42ba-b7c2-da82cbc10714 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Created reservations ['84401374-8629-4793-a0ed-5649a0985eed', 'd32e9905-2f4d-4f53-b958-055c453f8e22', '33376d54-8262-4b32-9dfd-a5d7aaeb3791', '9db2669f-b7d4-451a-b743-a0611af7881a'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:56:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-cf8e40cf-2882-42ba-b7c2-da82cbc10714 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-cf8e40cf-2882-42ba-b7c2-da82cbc10714 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-cf8e40cf-2882-42ba-b7c2-da82cbc10714 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-cf8e40cf-2882-42ba-b7c2-da82cbc10714 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-cf8e40cf-2882-42ba-b7c2-da82cbc10714 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cf8e40cf-2882-42ba-b7c2-da82cbc10714 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:30 devstack sudo[113558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:56:30 devstack sudo[113558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:30 devstack sudo[113558]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cf8e40cf-2882-42ba-b7c2-da82cbc10714 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.271s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:30 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-cf8e40cf-2882-42ba-b7c2-da82cbc10714 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:56:30 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-cf8e40cf-2882-42ba-b7c2-da82cbc10714 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Deleted volume successfully. Aug 27 03:56:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-cf8e40cf-2882-42ba-b7c2-da82cbc10714 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "cinder-23fe1c93-024f-49f6-aef6-0ef35c20bd78-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a171c39a-0e69-4921-8c34-dd75990db344 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "cinder-40010850-3271-406c-a37f-7c8fd15d33d4-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a171c39a-0e69-4921-8c34-dd75990db344 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "cinder-40010850-3271-406c-a37f-7c8fd15d33d4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a171c39a-0e69-4921-8c34-dd75990db344 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "cinder-quobyte-40010850-3271-406c-a37f-7c8fd15d33d4" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a171c39a-0e69-4921-8c34-dd75990db344 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "cinder-quobyte-40010850-3271-406c-a37f-7c8fd15d33d4" acquired by "delete_volume" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:30 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd366222-6286-4fda-a340-54a83882f578]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:56:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a171c39a-0e69-4921-8c34-dd75990db344 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-40010850-3271-406c-a37f-7c8fd15d33d4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:30 devstack sudo[113561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-40010850-3271-406c-a37f-7c8fd15d33d4 Aug 27 03:56:30 devstack sudo[113561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:30 devstack sudo[113561]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a171c39a-0e69-4921-8c34-dd75990db344 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-40010850-3271-406c-a37f-7c8fd15d33d4" returned: 0 in 0.410s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a171c39a-0e69-4921-8c34-dd75990db344 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-40010850-3271-406c-a37f-7c8fd15d33d4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:31 devstack sudo[113567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-40010850-3271-406c-a37f-7c8fd15d33d4 Aug 27 03:56:31 devstack sudo[113567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:31 devstack sudo[113567]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a171c39a-0e69-4921-8c34-dd75990db344 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-40010850-3271-406c-a37f-7c8fd15d33d4" returned: 0 in 0.259s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a171c39a-0e69-4921-8c34-dd75990db344 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "cinder-quobyte-40010850-3271-406c-a37f-7c8fd15d33d4" released by "delete_volume" :: held 0.707s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:31 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-a171c39a-0e69-4921-8c34-dd75990db344 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Created reservations ['024f143b-ab4e-4f6a-8ad8-1ad0b71aba39', '3d130427-349b-49c5-8d5b-def4a35ca8a4', 'ec83baad-2c64-4bcf-bb10-a15cb595c1ce', '31926e10-c11a-431b-9d98-5d87a23b7d87'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:56:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a171c39a-0e69-4921-8c34-dd75990db344 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a171c39a-0e69-4921-8c34-dd75990db344 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:31 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a171c39a-0e69-4921-8c34-dd75990db344 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:31 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a171c39a-0e69-4921-8c34-dd75990db344 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a171c39a-0e69-4921-8c34-dd75990db344 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a171c39a-0e69-4921-8c34-dd75990db344 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:31 devstack sudo[113570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:56:31 devstack sudo[113570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:31 devstack sudo[113570]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a171c39a-0e69-4921-8c34-dd75990db344 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.262s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:31 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-a171c39a-0e69-4921-8c34-dd75990db344 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:56:31 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-a171c39a-0e69-4921-8c34-dd75990db344 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Deleted volume successfully. Aug 27 03:56:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a171c39a-0e69-4921-8c34-dd75990db344 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "cinder-40010850-3271-406c-a37f-7c8fd15d33d4-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-fc71f6ae-9e3b-40db-b1e7-e6dac5ee6fca tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "cinder-888eebbb-e5ec-4619-8a9c-c1e66c6b0f56-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-fc71f6ae-9e3b-40db-b1e7-e6dac5ee6fca tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "cinder-888eebbb-e5ec-4619-8a9c-c1e66c6b0f56-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-fc71f6ae-9e3b-40db-b1e7-e6dac5ee6fca tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "cinder-quobyte-888eebbb-e5ec-4619-8a9c-c1e66c6b0f56" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-fc71f6ae-9e3b-40db-b1e7-e6dac5ee6fca tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "cinder-quobyte-888eebbb-e5ec-4619-8a9c-c1e66c6b0f56" acquired by "delete_volume" :: waited 0.018s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:31 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbbe492-db36-4044-a55f-cec65024d158]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:56:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fc71f6ae-9e3b-40db-b1e7-e6dac5ee6fca tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-888eebbb-e5ec-4619-8a9c-c1e66c6b0f56 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:31 devstack sudo[113574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-888eebbb-e5ec-4619-8a9c-c1e66c6b0f56 Aug 27 03:56:31 devstack sudo[113574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:32 devstack sudo[113574]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fc71f6ae-9e3b-40db-b1e7-e6dac5ee6fca tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-888eebbb-e5ec-4619-8a9c-c1e66c6b0f56" returned: 0 in 0.375s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fc71f6ae-9e3b-40db-b1e7-e6dac5ee6fca tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-888eebbb-e5ec-4619-8a9c-c1e66c6b0f56 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:32 devstack sudo[113579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-888eebbb-e5ec-4619-8a9c-c1e66c6b0f56 Aug 27 03:56:32 devstack sudo[113579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:32 devstack sudo[113579]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fc71f6ae-9e3b-40db-b1e7-e6dac5ee6fca tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-888eebbb-e5ec-4619-8a9c-c1e66c6b0f56" returned: 0 in 0.282s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-fc71f6ae-9e3b-40db-b1e7-e6dac5ee6fca tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "cinder-quobyte-888eebbb-e5ec-4619-8a9c-c1e66c6b0f56" released by "delete_volume" :: held 0.702s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:32 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-fc71f6ae-9e3b-40db-b1e7-e6dac5ee6fca tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Created reservations ['b2dea5f6-c8b1-4bcc-8921-871055b52dff', 'ef31d216-0e75-4162-9e92-78b25556c3fc', '018f3d49-676e-4558-b78a-1acc79c9bc53', 'eb8da001-aa1d-43cb-a29a-b1c199373db8'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:56:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fc71f6ae-9e3b-40db-b1e7-e6dac5ee6fca tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fc71f6ae-9e3b-40db-b1e7-e6dac5ee6fca tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-fc71f6ae-9e3b-40db-b1e7-e6dac5ee6fca tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-fc71f6ae-9e3b-40db-b1e7-e6dac5ee6fca tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fc71f6ae-9e3b-40db-b1e7-e6dac5ee6fca tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fc71f6ae-9e3b-40db-b1e7-e6dac5ee6fca tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:32 devstack sudo[113582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:56:32 devstack sudo[113582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:32 devstack sudo[113582]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fc71f6ae-9e3b-40db-b1e7-e6dac5ee6fca tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.261s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:32 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-fc71f6ae-9e3b-40db-b1e7-e6dac5ee6fca tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:56:32 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-fc71f6ae-9e3b-40db-b1e7-e6dac5ee6fca tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Deleted volume successfully. Aug 27 03:56:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-897b976a-ced3-49fd-800d-25106f4d4a45 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "cinder-7644c8ea-d1ee-4a08-a4a2-db81db83df86-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-fc71f6ae-9e3b-40db-b1e7-e6dac5ee6fca tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "cinder-888eebbb-e5ec-4619-8a9c-c1e66c6b0f56-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-897b976a-ced3-49fd-800d-25106f4d4a45 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "cinder-7644c8ea-d1ee-4a08-a4a2-db81db83df86-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-897b976a-ced3-49fd-800d-25106f4d4a45 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "cinder-quobyte-7644c8ea-d1ee-4a08-a4a2-db81db83df86" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-897b976a-ced3-49fd-800d-25106f4d4a45 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "cinder-quobyte-7644c8ea-d1ee-4a08-a4a2-db81db83df86" acquired by "delete_volume" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:32 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ebd036-655a-4986-981e-8195cd029705]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:56:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-897b976a-ced3-49fd-800d-25106f4d4a45 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7644c8ea-d1ee-4a08-a4a2-db81db83df86 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:33 devstack sudo[113585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7644c8ea-d1ee-4a08-a4a2-db81db83df86 Aug 27 03:56:33 devstack sudo[113585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:33 devstack sudo[113585]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-897b976a-ced3-49fd-800d-25106f4d4a45 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7644c8ea-d1ee-4a08-a4a2-db81db83df86" returned: 0 in 0.387s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-897b976a-ced3-49fd-800d-25106f4d4a45 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7644c8ea-d1ee-4a08-a4a2-db81db83df86 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:33 devstack sudo[113591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7644c8ea-d1ee-4a08-a4a2-db81db83df86 Aug 27 03:56:33 devstack sudo[113591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:33 devstack sudo[113591]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-897b976a-ced3-49fd-800d-25106f4d4a45 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7644c8ea-d1ee-4a08-a4a2-db81db83df86" returned: 0 in 0.254s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:33 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-897b976a-ced3-49fd-800d-25106f4d4a45 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "cinder-quobyte-7644c8ea-d1ee-4a08-a4a2-db81db83df86" released by "delete_volume" :: held 0.690s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:33 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-897b976a-ced3-49fd-800d-25106f4d4a45 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Created reservations ['712b5d94-9c91-4325-84c4-3182ea7cf663', 'efaa4c39-848c-4f9c-971d-9760c100adde', '1093acc0-1ae0-4496-b553-2993780f7403', '03132239-f5f9-45b6-8150-0400c460dfe4'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:56:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-897b976a-ced3-49fd-800d-25106f4d4a45 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-897b976a-ced3-49fd-800d-25106f4d4a45 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-897b976a-ced3-49fd-800d-25106f4d4a45 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-897b976a-ced3-49fd-800d-25106f4d4a45 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-897b976a-ced3-49fd-800d-25106f4d4a45 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-897b976a-ced3-49fd-800d-25106f4d4a45 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:33 devstack sudo[113594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:56:33 devstack sudo[113594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:34 devstack sudo[113594]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-897b976a-ced3-49fd-800d-25106f4d4a45 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.259s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-897b976a-ced3-49fd-800d-25106f4d4a45 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:56:34 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-897b976a-ced3-49fd-800d-25106f4d4a45 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Deleted volume successfully. Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-897b976a-ced3-49fd-800d-25106f4d4a45 tempest-CreateVolumesFromSourceVolumeTest-411061713 None] Lock "cinder-7644c8ea-d1ee-4a08-a4a2-db81db83df86-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Flow 'volume_create_manager' (45dd3320-aec9-465c-95fe-046ab6fd53ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfc7f54-423e-452f-8485-2405961c2616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfc7f54-423e-452f-8485-2405961c2616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1632081052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e35ef42f-d35e-4788-a49a-16515df83c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41dd5444dcc4a17971955da396e8faf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:34Z,use_quota=True,user_id='32197c1d7a1843f19a1b067b3299fa03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74085e9c-fdd8-4a52-b92d-799d421ce2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74085e9c-fdd8-4a52-b92d-799d421ce2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d30831-d20a-4791-8185-25637ddf2f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d30831-d20a-4791-8185-25637ddf2f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e35ef42f-d35e-4788-a49a-16515df83c86', 'volume_name': 'volume-e35ef42f-d35e-4788-a49a-16515df83c86', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c26779-79fc-4225-9e19-c5f8c783ae48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c26779-79fc-4225-9e19-c5f8c783ae48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8aae3d-618a-4731-8d63-b7738b0476f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:34 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Volume e35ef42f-d35e-4788-a49a-16515df83c86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e35ef42f-d35e-4788-a49a-16515df83c86', 'volume_size': 1} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1632081052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e35ef42f-d35e-4788-a49a-16515df83c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41dd5444dcc4a17971955da396e8faf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:34Z,use_quota=True,user_id='32197c1d7a1843f19a1b067b3299fa03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Creating volume e35ef42f-d35e-4788-a49a-16515df83c86 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:56:34 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e35ef42f-d35e-4788-a49a-16515df83c86 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:34 devstack sudo[113597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e35ef42f-d35e-4788-a49a-16515df83c86 1073741824 Aug 27 03:56:34 devstack sudo[113597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Flow 'volume_create_manager' (0aafc0b9-5a58-4b73-9e92-aa542fb78305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ede9fa-c31e-4bee-9996-332d51fc4fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ede9fa-c31e-4bee-9996-332d51fc4fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1879602353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30454b6b-f50e-4748-ac1d-b462c87898ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41dd5444dcc4a17971955da396e8faf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:35Z,use_quota=True,user_id='32197c1d7a1843f19a1b067b3299fa03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b2349e-0b93-4ab3-a75a-eeb99d7d76e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b2349e-0b93-4ab3-a75a-eeb99d7d76e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea2660ae-baa9-4961-83a1-1693dff0f57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea2660ae-baa9-4961-83a1-1693dff0f57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30454b6b-f50e-4748-ac1d-b462c87898ff', 'volume_name': 'volume-30454b6b-f50e-4748-ac1d-b462c87898ff', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df49aa5b-cd9d-4d13-8ce5-e0be26e95111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df49aa5b-cd9d-4d13-8ce5-e0be26e95111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b086767a-7b7e-488e-abd8-19b022a9509d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:34 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Volume 30454b6b-f50e-4748-ac1d-b462c87898ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30454b6b-f50e-4748-ac1d-b462c87898ff', 'volume_size': 1} Aug 27 03:56:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:35 devstack sudo[113597]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e35ef42f-d35e-4788-a49a-16515df83c86 1073741824" returned: 0 in 0.580s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e35ef42f-d35e-4788-a49a-16515df83c86 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:35 devstack sudo[113603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e35ef42f-d35e-4788-a49a-16515df83c86 Aug 27 03:56:35 devstack sudo[113603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Flow 'volume_create_manager' (edfec7f4-172a-42ec-82a9-093b7058b0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db849e28-6be0-47cd-9eb4-5ffc072e26c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db849e28-6be0-47cd-9eb4-5ffc072e26c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-184432053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08ffe71-d15e-47cd-8fbf-cd7402bf387f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41dd5444dcc4a17971955da396e8faf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:35Z,use_quota=True,user_id='32197c1d7a1843f19a1b067b3299fa03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a2c892-33b6-47e5-9377-295d4863afdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a2c892-33b6-47e5-9377-295d4863afdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed1ec17-b201-4902-b32f-8cde2b8a8e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed1ec17-b201-4902-b32f-8cde2b8a8e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd08ffe71-d15e-47cd-8fbf-cd7402bf387f', 'volume_name': 'volume-d08ffe71-d15e-47cd-8fbf-cd7402bf387f', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620c85b6-93d4-47ec-8d02-38553fdae528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620c85b6-93d4-47ec-8d02-38553fdae528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1481355c-6b33-4514-be44-8942ad986e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:35 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Volume d08ffe71-d15e-47cd-8fbf-cd7402bf387f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d08ffe71-d15e-47cd-8fbf-cd7402bf387f', 'volume_size': 1} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:35 devstack sudo[113603]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e35ef42f-d35e-4788-a49a-16515df83c86" returned: 0 in 0.325s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.577s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1879602353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30454b6b-f50e-4748-ac1d-b462c87898ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41dd5444dcc4a17971955da396e8faf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:35Z,use_quota=True,user_id='32197c1d7a1843f19a1b067b3299fa03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Creating volume 30454b6b-f50e-4748-ac1d-b462c87898ff {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:56:35 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30454b6b-f50e-4748-ac1d-b462c87898ff 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8aae3d-618a-4731-8d63-b7738b0476f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e35ef42f-d35e-4788-a49a-16515df83c86', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (230e129b-e827-489a-934b-745dbe29eb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:35 devstack sudo[113606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30454b6b-f50e-4748-ac1d-b462c87898ff 1073741824 Aug 27 03:56:35 devstack sudo[113606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:35 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Volume volume-e35ef42f-d35e-4788-a49a-16515df83c86 (e35ef42f-d35e-4788-a49a-16515df83c86): created successfully Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (230e129b-e827-489a-934b-745dbe29eb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Flow 'volume_create_manager' (45dd3320-aec9-465c-95fe-046ab6fd53ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:35 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-dc87d50d-b40d-43db-baca-151e022378e1 tempest-CreateVolumesFromImageTest-613418762 None] Created volume successfully. Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Flow 'volume_create_manager' (53f783db-c7b9-4f47-8f73-a58f09e79bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0240a339-95b2-40c4-b173-581c81527077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0240a339-95b2-40c4-b173-581c81527077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1302338040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41dd5444dcc4a17971955da396e8faf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:36Z,use_quota=True,user_id='32197c1d7a1843f19a1b067b3299fa03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788b8fc2-9856-414e-80b0-5e7276854fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788b8fc2-9856-414e-80b0-5e7276854fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c135f4d-6a2e-4bd5-a56c-0a745935ee03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c135f4d-6a2e-4bd5-a56c-0a745935ee03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b', 'volume_name': 'volume-8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10d142d0-2c1c-4dfd-a45d-1c6e98200dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10d142d0-2c1c-4dfd-a45d-1c6e98200dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428f3c50-fe67-4c9a-88d4-2a2a1fcfd005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:35 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Volume 8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b', 'volume_size': 1} Aug 27 03:56:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:36 devstack sudo[113606]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30454b6b-f50e-4748-ac1d-b462c87898ff 1073741824" returned: 0 in 0.605s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30454b6b-f50e-4748-ac1d-b462c87898ff {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:56:36 devstack sudo[113612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30454b6b-f50e-4748-ac1d-b462c87898ff Aug 27 03:56:36 devstack sudo[113612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Flow 'volume_create_manager' (67559fc5-6e60-49d5-a78f-064de2f17fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b1d42d-1904-4c81-9a48-0ab39cbbfe58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b1d42d-1904-4c81-9a48-0ab39cbbfe58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-124355628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb3f68f-9a5d-4a93-a191-3115d4e0d838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41dd5444dcc4a17971955da396e8faf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:36Z,use_quota=True,user_id='32197c1d7a1843f19a1b067b3299fa03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c684ab-751d-4626-b3d4-490acb8663ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c684ab-751d-4626-b3d4-490acb8663ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e8b968-f40f-472b-b710-224d8028f1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e8b968-f40f-472b-b710-224d8028f1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eb3f68f-9a5d-4a93-a191-3115d4e0d838', 'volume_name': 'volume-1eb3f68f-9a5d-4a93-a191-3115d4e0d838', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458e9b37-6763-4cf0-b035-dbc9a0262d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458e9b37-6763-4cf0-b035-dbc9a0262d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bd67782-f4b5-4916-944b-c4fc51c80c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:36 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Volume 1eb3f68f-9a5d-4a93-a191-3115d4e0d838: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eb3f68f-9a5d-4a93-a191-3115d4e0d838', 'volume_size': 1} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:36 devstack sudo[113612]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30454b6b-f50e-4748-ac1d-b462c87898ff" returned: 0 in 0.248s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.086s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-184432053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08ffe71-d15e-47cd-8fbf-cd7402bf387f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41dd5444dcc4a17971955da396e8faf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:35Z,use_quota=True,user_id='32197c1d7a1843f19a1b067b3299fa03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Creating volume d08ffe71-d15e-47cd-8fbf-cd7402bf387f {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:56:36 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d08ffe71-d15e-47cd-8fbf-cd7402bf387f 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b086767a-7b7e-488e-abd8-19b022a9509d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30454b6b-f50e-4748-ac1d-b462c87898ff', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:36 devstack sudo[113615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d08ffe71-d15e-47cd-8fbf-cd7402bf387f 1073741824 Aug 27 03:56:36 devstack sudo[113615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f698c87-580c-4f82-a5e7-bdd7d0dc6fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:36 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Volume volume-30454b6b-f50e-4748-ac1d-b462c87898ff (30454b6b-f50e-4748-ac1d-b462c87898ff): created successfully Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f698c87-580c-4f82-a5e7-bdd7d0dc6fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Flow 'volume_create_manager' (0aafc0b9-5a58-4b73-9e92-aa542fb78305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:36 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-a727625d-376b-4316-b47e-2f8f4b829776 tempest-CreateVolumesFromImageTest-613418762 None] Created volume successfully. Aug 27 03:56:36 devstack sudo[113615]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d08ffe71-d15e-47cd-8fbf-cd7402bf387f 1073741824" returned: 0 in 0.397s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d08ffe71-d15e-47cd-8fbf-cd7402bf387f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:36 devstack sudo[113621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d08ffe71-d15e-47cd-8fbf-cd7402bf387f Aug 27 03:56:36 devstack sudo[113621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:37 devstack sudo[113621]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d08ffe71-d15e-47cd-8fbf-cd7402bf387f" returned: 0 in 0.252s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.330s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1302338040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41dd5444dcc4a17971955da396e8faf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:36Z,use_quota=True,user_id='32197c1d7a1843f19a1b067b3299fa03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Creating volume 8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:56:37 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1481355c-6b33-4514-be44-8942ad986e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d08ffe71-d15e-47cd-8fbf-cd7402bf387f', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:37 devstack sudo[113624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b 1073741824 Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2092b4d0-6bc6-4092-880d-b21371501968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:37 devstack sudo[113624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:37 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Volume volume-d08ffe71-d15e-47cd-8fbf-cd7402bf387f (d08ffe71-d15e-47cd-8fbf-cd7402bf387f): created successfully Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2092b4d0-6bc6-4092-880d-b21371501968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Flow 'volume_create_manager' (edfec7f4-172a-42ec-82a9-093b7058b0af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:37 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-0990c577-f5e8-4230-aedb-5aeaae120ded tempest-CreateVolumesFromImageTest-613418762 None] Created volume successfully. Aug 27 03:56:37 devstack sudo[113624]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b 1073741824" returned: 0 in 0.404s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:37 devstack sudo[113629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b Aug 27 03:56:37 devstack sudo[113629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:37 devstack sudo[113629]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b" returned: 0 in 0.243s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.530s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-124355628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb3f68f-9a5d-4a93-a191-3115d4e0d838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41dd5444dcc4a17971955da396e8faf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:36Z,use_quota=True,user_id='32197c1d7a1843f19a1b067b3299fa03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Creating volume 1eb3f68f-9a5d-4a93-a191-3115d4e0d838 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:56:37 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-1eb3f68f-9a5d-4a93-a191-3115d4e0d838 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:37 devstack sudo[113632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-1eb3f68f-9a5d-4a93-a191-3115d4e0d838 1073741824 Aug 27 03:56:37 devstack sudo[113632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428f3c50-fe67-4c9a-88d4-2a2a1fcfd005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10ade70-5e82-4c47-9d86-8029552c175e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:37 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Volume volume-8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b (8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b): created successfully Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10ade70-5e82-4c47-9d86-8029552c175e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:37 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Flow 'volume_create_manager' (53f783db-c7b9-4f47-8f73-a58f09e79bd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:37 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-9a4c28bc-6c77-4b0e-9316-3b206c9e6eb0 tempest-CreateVolumesFromImageTest-613418762 None] Created volume successfully. Aug 27 03:56:38 devstack sudo[113632]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-1eb3f68f-9a5d-4a93-a191-3115d4e0d838 1073741824" returned: 0 in 0.442s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-1eb3f68f-9a5d-4a93-a191-3115d4e0d838 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:38 devstack sudo[113638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-1eb3f68f-9a5d-4a93-a191-3115d4e0d838 Aug 27 03:56:38 devstack sudo[113638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:38 devstack sudo[113638]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-1eb3f68f-9a5d-4a93-a191-3115d4e0d838" returned: 0 in 0.236s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:38 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:56:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:38 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bd67782-f4b5-4916-944b-c4fc51c80c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eb3f68f-9a5d-4a93-a191-3115d4e0d838', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:38 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db19ce9-1549-4117-a24b-64b3dc3b1958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:38 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Volume volume-1eb3f68f-9a5d-4a93-a191-3115d4e0d838 (1eb3f68f-9a5d-4a93-a191-3115d4e0d838): created successfully Aug 27 03:56:38 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db19ce9-1549-4117-a24b-64b3dc3b1958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:38 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Flow 'volume_create_manager' (67559fc5-6e60-49d5-a78f-064de2f17fd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:38 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-ed232351-23df-4016-a619-01e8022e3cf1 tempest-CreateVolumesFromImageTest-613418762 None] Created volume successfully. Aug 27 03:56:39 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-bfc24042-69df-45c6-a272-5156db8918fc tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "cinder-1eb3f68f-9a5d-4a93-a191-3115d4e0d838-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:39 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-bfc24042-69df-45c6-a272-5156db8918fc tempest-CreateVolumesFromImageTest-613418762 None] Lock "cinder-1eb3f68f-9a5d-4a93-a191-3115d4e0d838-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:39 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-bfc24042-69df-45c6-a272-5156db8918fc tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "cinder-quobyte-1eb3f68f-9a5d-4a93-a191-3115d4e0d838" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:39 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-bfc24042-69df-45c6-a272-5156db8918fc tempest-CreateVolumesFromImageTest-613418762 None] Lock "cinder-quobyte-1eb3f68f-9a5d-4a93-a191-3115d4e0d838" acquired by "delete_volume" :: waited 0.014s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:39 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[f679d2be-a889-4f58-a500-71d102531502]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:56:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-bfc24042-69df-45c6-a272-5156db8918fc tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-1eb3f68f-9a5d-4a93-a191-3115d4e0d838 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:39 devstack sudo[113641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-1eb3f68f-9a5d-4a93-a191-3115d4e0d838 Aug 27 03:56:39 devstack sudo[113641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:39 devstack sudo[113641]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-bfc24042-69df-45c6-a272-5156db8918fc tempest-CreateVolumesFromImageTest-613418762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-1eb3f68f-9a5d-4a93-a191-3115d4e0d838" returned: 0 in 0.346s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-bfc24042-69df-45c6-a272-5156db8918fc tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-1eb3f68f-9a5d-4a93-a191-3115d4e0d838 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:39 devstack sudo[113646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-1eb3f68f-9a5d-4a93-a191-3115d4e0d838 Aug 27 03:56:39 devstack sudo[113646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:40 devstack sudo[113646]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-bfc24042-69df-45c6-a272-5156db8918fc tempest-CreateVolumesFromImageTest-613418762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-1eb3f68f-9a5d-4a93-a191-3115d4e0d838" returned: 0 in 0.243s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:40 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-bfc24042-69df-45c6-a272-5156db8918fc tempest-CreateVolumesFromImageTest-613418762 None] Lock "cinder-quobyte-1eb3f68f-9a5d-4a93-a191-3115d4e0d838" released by "delete_volume" :: held 0.625s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:40 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-bfc24042-69df-45c6-a272-5156db8918fc tempest-CreateVolumesFromImageTest-613418762 None] Created reservations ['e51c0d20-f5b0-47d1-aafc-a39fb7b70013', '7484e95f-e06a-40dc-b392-0dd4cd17d9ce', '397f9e2d-5420-484b-93b2-bf04fdeb2774', 'cfc60087-3f91-405f-b7c3-f2d070e79e1b'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:56:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-bfc24042-69df-45c6-a272-5156db8918fc tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-bfc24042-69df-45c6-a272-5156db8918fc tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:40 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-bfc24042-69df-45c6-a272-5156db8918fc tempest-CreateVolumesFromImageTest-613418762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:40 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-bfc24042-69df-45c6-a272-5156db8918fc tempest-CreateVolumesFromImageTest-613418762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-bfc24042-69df-45c6-a272-5156db8918fc tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-bfc24042-69df-45c6-a272-5156db8918fc tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:40 devstack sudo[113649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:56:40 devstack sudo[113649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:40 devstack sudo[113649]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-bfc24042-69df-45c6-a272-5156db8918fc tempest-CreateVolumesFromImageTest-613418762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.236s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:40 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-bfc24042-69df-45c6-a272-5156db8918fc tempest-CreateVolumesFromImageTest-613418762 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:56:40 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-bfc24042-69df-45c6-a272-5156db8918fc tempest-CreateVolumesFromImageTest-613418762 None] Deleted volume successfully. Aug 27 03:56:40 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-bfc24042-69df-45c6-a272-5156db8918fc tempest-CreateVolumesFromImageTest-613418762 None] Lock "cinder-1eb3f68f-9a5d-4a93-a191-3115d4e0d838-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:40 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-26c18eaa-8a89-46de-8a91-9d9f86615e27 tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "cinder-8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:40 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-26c18eaa-8a89-46de-8a91-9d9f86615e27 tempest-CreateVolumesFromImageTest-613418762 None] Lock "cinder-8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:40 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-26c18eaa-8a89-46de-8a91-9d9f86615e27 tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "cinder-quobyte-8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:40 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-26c18eaa-8a89-46de-8a91-9d9f86615e27 tempest-CreateVolumesFromImageTest-613418762 None] Lock "cinder-quobyte-8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b" acquired by "delete_volume" :: waited 0.014s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:40 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18dd842-c35e-4a55-9013-d819db4894cf]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:56:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-26c18eaa-8a89-46de-8a91-9d9f86615e27 tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:40 devstack sudo[113652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b Aug 27 03:56:40 devstack sudo[113652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:41 devstack sudo[113652]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-26c18eaa-8a89-46de-8a91-9d9f86615e27 tempest-CreateVolumesFromImageTest-613418762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b" returned: 0 in 0.348s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-26c18eaa-8a89-46de-8a91-9d9f86615e27 tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:41 devstack sudo[113657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b Aug 27 03:56:41 devstack sudo[113657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:41 devstack sudo[113657]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-26c18eaa-8a89-46de-8a91-9d9f86615e27 tempest-CreateVolumesFromImageTest-613418762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b" returned: 0 in 0.250s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-26c18eaa-8a89-46de-8a91-9d9f86615e27 tempest-CreateVolumesFromImageTest-613418762 None] Lock "cinder-quobyte-8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b" released by "delete_volume" :: held 0.637s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:41 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-26c18eaa-8a89-46de-8a91-9d9f86615e27 tempest-CreateVolumesFromImageTest-613418762 None] Created reservations ['4746cd73-ed06-455a-accb-2c1b87e3ef84', '62a742a5-dca2-418f-8261-fc340fb416be', '1a083325-5048-4b71-910a-b6ee75effc32', '5cb13517-2587-421b-a2e0-f7ab7e9f9ba4'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:56:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-26c18eaa-8a89-46de-8a91-9d9f86615e27 tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-26c18eaa-8a89-46de-8a91-9d9f86615e27 tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-26c18eaa-8a89-46de-8a91-9d9f86615e27 tempest-CreateVolumesFromImageTest-613418762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-26c18eaa-8a89-46de-8a91-9d9f86615e27 tempest-CreateVolumesFromImageTest-613418762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-26c18eaa-8a89-46de-8a91-9d9f86615e27 tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-26c18eaa-8a89-46de-8a91-9d9f86615e27 tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:41 devstack sudo[113660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:56:41 devstack sudo[113660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:41 devstack sudo[113660]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-26c18eaa-8a89-46de-8a91-9d9f86615e27 tempest-CreateVolumesFromImageTest-613418762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.237s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:41 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-26c18eaa-8a89-46de-8a91-9d9f86615e27 tempest-CreateVolumesFromImageTest-613418762 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:56:41 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-26c18eaa-8a89-46de-8a91-9d9f86615e27 tempest-CreateVolumesFromImageTest-613418762 None] Deleted volume successfully. Aug 27 03:56:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-26c18eaa-8a89-46de-8a91-9d9f86615e27 tempest-CreateVolumesFromImageTest-613418762 None] Lock "cinder-8fe3fbf0-7463-493d-8bcf-fe4ad2738f2b-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-43048ee5-5b0b-49b0-ba1e-a1d76f9b6fd4 tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "cinder-d08ffe71-d15e-47cd-8fbf-cd7402bf387f-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-43048ee5-5b0b-49b0-ba1e-a1d76f9b6fd4 tempest-CreateVolumesFromImageTest-613418762 None] Lock "cinder-d08ffe71-d15e-47cd-8fbf-cd7402bf387f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-43048ee5-5b0b-49b0-ba1e-a1d76f9b6fd4 tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "cinder-quobyte-d08ffe71-d15e-47cd-8fbf-cd7402bf387f" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-43048ee5-5b0b-49b0-ba1e-a1d76f9b6fd4 tempest-CreateVolumesFromImageTest-613418762 None] Lock "cinder-quobyte-d08ffe71-d15e-47cd-8fbf-cd7402bf387f" acquired by "delete_volume" :: waited 0.014s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:41 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[623bad26-2471-49e1-98f9-9caf9cf4dc14]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:56:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-43048ee5-5b0b-49b0-ba1e-a1d76f9b6fd4 tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d08ffe71-d15e-47cd-8fbf-cd7402bf387f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:41 devstack sudo[113663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d08ffe71-d15e-47cd-8fbf-cd7402bf387f Aug 27 03:56:41 devstack sudo[113663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:42 devstack sudo[113663]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-43048ee5-5b0b-49b0-ba1e-a1d76f9b6fd4 tempest-CreateVolumesFromImageTest-613418762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d08ffe71-d15e-47cd-8fbf-cd7402bf387f" returned: 0 in 0.348s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-43048ee5-5b0b-49b0-ba1e-a1d76f9b6fd4 tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d08ffe71-d15e-47cd-8fbf-cd7402bf387f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:42 devstack sudo[113668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d08ffe71-d15e-47cd-8fbf-cd7402bf387f Aug 27 03:56:42 devstack sudo[113668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:42 devstack sudo[113668]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-43048ee5-5b0b-49b0-ba1e-a1d76f9b6fd4 tempest-CreateVolumesFromImageTest-613418762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d08ffe71-d15e-47cd-8fbf-cd7402bf387f" returned: 0 in 0.235s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-43048ee5-5b0b-49b0-ba1e-a1d76f9b6fd4 tempest-CreateVolumesFromImageTest-613418762 None] Lock "cinder-quobyte-d08ffe71-d15e-47cd-8fbf-cd7402bf387f" released by "delete_volume" :: held 0.621s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:42 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-43048ee5-5b0b-49b0-ba1e-a1d76f9b6fd4 tempest-CreateVolumesFromImageTest-613418762 None] Created reservations ['e453e87d-f43f-4b4e-a909-700abf890847', 'fafab7b6-e57d-4a0e-a6c3-62fb3b4ed65e', '32e7e72b-40b7-4fa3-89f9-48bd996203c0', '098f9f70-d707-4a9b-bd55-3f13b38cea91'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:56:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-43048ee5-5b0b-49b0-ba1e-a1d76f9b6fd4 tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-43048ee5-5b0b-49b0-ba1e-a1d76f9b6fd4 tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:42 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-43048ee5-5b0b-49b0-ba1e-a1d76f9b6fd4 tempest-CreateVolumesFromImageTest-613418762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:42 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-43048ee5-5b0b-49b0-ba1e-a1d76f9b6fd4 tempest-CreateVolumesFromImageTest-613418762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-43048ee5-5b0b-49b0-ba1e-a1d76f9b6fd4 tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-43048ee5-5b0b-49b0-ba1e-a1d76f9b6fd4 tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:42 devstack sudo[113671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:56:42 devstack sudo[113671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:42 devstack sudo[113671]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-43048ee5-5b0b-49b0-ba1e-a1d76f9b6fd4 tempest-CreateVolumesFromImageTest-613418762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.240s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:42 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-43048ee5-5b0b-49b0-ba1e-a1d76f9b6fd4 tempest-CreateVolumesFromImageTest-613418762 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:56:42 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-43048ee5-5b0b-49b0-ba1e-a1d76f9b6fd4 tempest-CreateVolumesFromImageTest-613418762 None] Deleted volume successfully. Aug 27 03:56:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-43048ee5-5b0b-49b0-ba1e-a1d76f9b6fd4 tempest-CreateVolumesFromImageTest-613418762 None] Lock "cinder-d08ffe71-d15e-47cd-8fbf-cd7402bf387f-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f9d268c9-9f4b-4aad-a579-fe5ede181d1f tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "cinder-30454b6b-f50e-4748-ac1d-b462c87898ff-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f9d268c9-9f4b-4aad-a579-fe5ede181d1f tempest-CreateVolumesFromImageTest-613418762 None] Lock "cinder-30454b6b-f50e-4748-ac1d-b462c87898ff-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f9d268c9-9f4b-4aad-a579-fe5ede181d1f tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "cinder-quobyte-30454b6b-f50e-4748-ac1d-b462c87898ff" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f9d268c9-9f4b-4aad-a579-fe5ede181d1f tempest-CreateVolumesFromImageTest-613418762 None] Lock "cinder-quobyte-30454b6b-f50e-4748-ac1d-b462c87898ff" acquired by "delete_volume" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:42 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd55617-98ec-4c75-abd6-c79a60e5bb96]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:56:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f9d268c9-9f4b-4aad-a579-fe5ede181d1f tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30454b6b-f50e-4748-ac1d-b462c87898ff {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:43 devstack sudo[113674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30454b6b-f50e-4748-ac1d-b462c87898ff Aug 27 03:56:43 devstack sudo[113674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:43 devstack sudo[113674]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f9d268c9-9f4b-4aad-a579-fe5ede181d1f tempest-CreateVolumesFromImageTest-613418762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30454b6b-f50e-4748-ac1d-b462c87898ff" returned: 0 in 0.356s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f9d268c9-9f4b-4aad-a579-fe5ede181d1f tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30454b6b-f50e-4748-ac1d-b462c87898ff {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:43 devstack sudo[113680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30454b6b-f50e-4748-ac1d-b462c87898ff Aug 27 03:56:43 devstack sudo[113680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:43 devstack sudo[113680]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f9d268c9-9f4b-4aad-a579-fe5ede181d1f tempest-CreateVolumesFromImageTest-613418762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-30454b6b-f50e-4748-ac1d-b462c87898ff" returned: 0 in 0.235s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f9d268c9-9f4b-4aad-a579-fe5ede181d1f tempest-CreateVolumesFromImageTest-613418762 None] Lock "cinder-quobyte-30454b6b-f50e-4748-ac1d-b462c87898ff" released by "delete_volume" :: held 0.629s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:43 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-f9d268c9-9f4b-4aad-a579-fe5ede181d1f tempest-CreateVolumesFromImageTest-613418762 None] Created reservations ['0399832b-4e4a-40c9-b7a8-556ff1886f53', '25b7194b-820d-455f-90e6-b8c60b512cd9', '15363cc1-7ad6-4402-929c-224250b5fa81', 'c80ce2bf-a5db-4832-9a5d-325c186fc30f'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:56:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f9d268c9-9f4b-4aad-a579-fe5ede181d1f tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f9d268c9-9f4b-4aad-a579-fe5ede181d1f tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f9d268c9-9f4b-4aad-a579-fe5ede181d1f tempest-CreateVolumesFromImageTest-613418762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f9d268c9-9f4b-4aad-a579-fe5ede181d1f tempest-CreateVolumesFromImageTest-613418762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f9d268c9-9f4b-4aad-a579-fe5ede181d1f tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f9d268c9-9f4b-4aad-a579-fe5ede181d1f tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:43 devstack sudo[113683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:56:43 devstack sudo[113683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:43 devstack sudo[113683]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f9d268c9-9f4b-4aad-a579-fe5ede181d1f tempest-CreateVolumesFromImageTest-613418762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.232s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:43 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-f9d268c9-9f4b-4aad-a579-fe5ede181d1f tempest-CreateVolumesFromImageTest-613418762 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:56:43 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f9d268c9-9f4b-4aad-a579-fe5ede181d1f tempest-CreateVolumesFromImageTest-613418762 None] Deleted volume successfully. Aug 27 03:56:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f9d268c9-9f4b-4aad-a579-fe5ede181d1f tempest-CreateVolumesFromImageTest-613418762 None] Lock "cinder-30454b6b-f50e-4748-ac1d-b462c87898ff-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2b253c96-e294-4ad1-b788-976a761caf17 tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "cinder-e35ef42f-d35e-4788-a49a-16515df83c86-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2b253c96-e294-4ad1-b788-976a761caf17 tempest-CreateVolumesFromImageTest-613418762 None] Lock "cinder-e35ef42f-d35e-4788-a49a-16515df83c86-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2b253c96-e294-4ad1-b788-976a761caf17 tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "cinder-quobyte-e35ef42f-d35e-4788-a49a-16515df83c86" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2b253c96-e294-4ad1-b788-976a761caf17 tempest-CreateVolumesFromImageTest-613418762 None] Lock "cinder-quobyte-e35ef42f-d35e-4788-a49a-16515df83c86" acquired by "delete_volume" :: waited 0.013s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:44 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[c899fbf2-6291-4f9e-ae6d-d1bed84ad687]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:56:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2b253c96-e294-4ad1-b788-976a761caf17 tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e35ef42f-d35e-4788-a49a-16515df83c86 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:44 devstack sudo[113686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e35ef42f-d35e-4788-a49a-16515df83c86 Aug 27 03:56:44 devstack sudo[113686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:44 devstack sudo[113686]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2b253c96-e294-4ad1-b788-976a761caf17 tempest-CreateVolumesFromImageTest-613418762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e35ef42f-d35e-4788-a49a-16515df83c86" returned: 0 in 0.344s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2b253c96-e294-4ad1-b788-976a761caf17 tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e35ef42f-d35e-4788-a49a-16515df83c86 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:44 devstack sudo[113691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e35ef42f-d35e-4788-a49a-16515df83c86 Aug 27 03:56:44 devstack sudo[113691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:44 devstack sudo[113691]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2b253c96-e294-4ad1-b788-976a761caf17 tempest-CreateVolumesFromImageTest-613418762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e35ef42f-d35e-4788-a49a-16515df83c86" returned: 0 in 0.236s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2b253c96-e294-4ad1-b788-976a761caf17 tempest-CreateVolumesFromImageTest-613418762 None] Lock "cinder-quobyte-e35ef42f-d35e-4788-a49a-16515df83c86" released by "delete_volume" :: held 0.613s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:44 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-2b253c96-e294-4ad1-b788-976a761caf17 tempest-CreateVolumesFromImageTest-613418762 None] Created reservations ['c716de30-8591-4573-8234-fe204d667e60', '4677a26f-1df5-4ba9-ae91-85c8b9d36b34', '1021099d-a40f-42e6-8146-ea415ce1b848', '12255653-751a-4c3b-82f4-41212f947b1c'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:56:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2b253c96-e294-4ad1-b788-976a761caf17 tempest-CreateVolumesFromImageTest-613418762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2b253c96-e294-4ad1-b788-976a761caf17 tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2b253c96-e294-4ad1-b788-976a761caf17 tempest-CreateVolumesFromImageTest-613418762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2b253c96-e294-4ad1-b788-976a761caf17 tempest-CreateVolumesFromImageTest-613418762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2b253c96-e294-4ad1-b788-976a761caf17 tempest-CreateVolumesFromImageTest-613418762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2b253c96-e294-4ad1-b788-976a761caf17 tempest-CreateVolumesFromImageTest-613418762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:44 devstack sudo[113694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:56:44 devstack sudo[113694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:45 devstack sudo[113694]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2b253c96-e294-4ad1-b788-976a761caf17 tempest-CreateVolumesFromImageTest-613418762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.232s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:45 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-2b253c96-e294-4ad1-b788-976a761caf17 tempest-CreateVolumesFromImageTest-613418762 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:56:45 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-2b253c96-e294-4ad1-b788-976a761caf17 tempest-CreateVolumesFromImageTest-613418762 None] Deleted volume successfully. Aug 27 03:56:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2b253c96-e294-4ad1-b788-976a761caf17 tempest-CreateVolumesFromImageTest-613418762 None] Lock "cinder-e35ef42f-d35e-4788-a49a-16515df83c86-delete_volume" released by "delete_volume" :: held 1.032s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:48 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:56:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Flow 'volume_create_manager' (23a0bd9a-e798-46bf-a39f-4417269fe0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfaa9c05-0403-4a33-b32b-2ec9c3fb4d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfaa9c05-0403-4a33-b32b-2ec9c3fb4d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1231931506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8896f9c-e209-4950-be31-1415b1b2e44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d8cbe1f77348419416c8952ebf70a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:48Z,use_quota=True,user_id='ef2dfd9efcb6474e9ec10f36b53b4acd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b9c6fd-974d-4821-b908-0633e5132b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b9c6fd-974d-4821-b908-0633e5132b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c79f46-15c6-4f6e-ac7e-727c91185503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c79f46-15c6-4f6e-ac7e-727c91185503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8896f9c-e209-4950-be31-1415b1b2e44a', 'volume_name': 'volume-c8896f9c-e209-4950-be31-1415b1b2e44a', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d739d59-b060-4dcf-900d-03936f913611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d739d59-b060-4dcf-900d-03936f913611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe0b7c5-fc95-477f-b4a0-8ed9af26d2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:48 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Volume c8896f9c-e209-4950-be31-1415b1b2e44a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8896f9c-e209-4950-be31-1415b1b2e44a', 'volume_size': 1} Aug 27 03:56:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1231931506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8896f9c-e209-4950-be31-1415b1b2e44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d8cbe1f77348419416c8952ebf70a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:48Z,use_quota=True,user_id='ef2dfd9efcb6474e9ec10f36b53b4acd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:56:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Creating volume c8896f9c-e209-4950-be31-1415b1b2e44a {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:56:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:56:48 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:56:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c8896f9c-e209-4950-be31-1415b1b2e44a 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:48 devstack sudo[113697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c8896f9c-e209-4950-be31-1415b1b2e44a 1073741824 Aug 27 03:56:48 devstack sudo[113697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:48 devstack sudo[113697]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c8896f9c-e209-4950-be31-1415b1b2e44a 1073741824" returned: 0 in 0.382s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c8896f9c-e209-4950-be31-1415b1b2e44a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:48 devstack sudo[113703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c8896f9c-e209-4950-be31-1415b1b2e44a Aug 27 03:56:48 devstack sudo[113703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:49 devstack sudo[113703]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c8896f9c-e209-4950-be31-1415b1b2e44a" returned: 0 in 0.227s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:49 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] <== create_volume: return (647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:56:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.649s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe0b7c5-fc95-477f-b4a0-8ed9af26d2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8896f9c-e209-4950-be31-1415b1b2e44a', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40dc08b0-fa51-40f5-a135-fbe589bd141c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:49 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Volume volume-c8896f9c-e209-4950-be31-1415b1b2e44a (c8896f9c-e209-4950-be31-1415b1b2e44a): created successfully Aug 27 03:56:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40dc08b0-fa51-40f5-a135-fbe589bd141c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Flow 'volume_create_manager' (23a0bd9a-e798-46bf-a39f-4417269fe0d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:49 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d54cb189-a657-4214-9cdc-0b6f7621e9be tempest-ProjectReaderTests-857628909 None] Created volume successfully. Aug 27 03:56:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8384466c-3615-4594-a0c9-baddc7eadc09 tempest-ProjectReaderTests-857628909 None] Acquiring lock "cinder-c8896f9c-e209-4950-be31-1415b1b2e44a-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8384466c-3615-4594-a0c9-baddc7eadc09 tempest-ProjectReaderTests-857628909 None] Lock "cinder-c8896f9c-e209-4950-be31-1415b1b2e44a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8384466c-3615-4594-a0c9-baddc7eadc09 tempest-ProjectReaderTests-857628909 None] Acquiring lock "cinder-quobyte-c8896f9c-e209-4950-be31-1415b1b2e44a" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8384466c-3615-4594-a0c9-baddc7eadc09 tempest-ProjectReaderTests-857628909 None] Lock "cinder-quobyte-c8896f9c-e209-4950-be31-1415b1b2e44a" acquired by "delete_volume" :: waited 0.014s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:49 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[e906d9c5-7916-42d7-9970-49bfef185c7c]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:56:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8384466c-3615-4594-a0c9-baddc7eadc09 tempest-ProjectReaderTests-857628909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c8896f9c-e209-4950-be31-1415b1b2e44a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:49 devstack sudo[113706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c8896f9c-e209-4950-be31-1415b1b2e44a Aug 27 03:56:49 devstack sudo[113706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:49 devstack sudo[113706]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8384466c-3615-4594-a0c9-baddc7eadc09 tempest-ProjectReaderTests-857628909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c8896f9c-e209-4950-be31-1415b1b2e44a" returned: 0 in 0.341s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8384466c-3615-4594-a0c9-baddc7eadc09 tempest-ProjectReaderTests-857628909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c8896f9c-e209-4950-be31-1415b1b2e44a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:50 devstack sudo[113711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c8896f9c-e209-4950-be31-1415b1b2e44a Aug 27 03:56:50 devstack sudo[113711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:50 devstack sudo[113711]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8384466c-3615-4594-a0c9-baddc7eadc09 tempest-ProjectReaderTests-857628909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c8896f9c-e209-4950-be31-1415b1b2e44a" returned: 0 in 0.244s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8384466c-3615-4594-a0c9-baddc7eadc09 tempest-ProjectReaderTests-857628909 None] Lock "cinder-quobyte-c8896f9c-e209-4950-be31-1415b1b2e44a" released by "delete_volume" :: held 0.626s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:50 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-8384466c-3615-4594-a0c9-baddc7eadc09 tempest-ProjectReaderTests-857628909 None] Created reservations ['041a5c6a-274a-4170-bfe7-24aca3784e77', '39eb91af-e405-4e59-857c-06878721d020', '23b651a4-6226-4916-a487-4de1a92e00f3', '416f775e-4f97-4df2-8e14-640d6e528244'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:56:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8384466c-3615-4594-a0c9-baddc7eadc09 tempest-ProjectReaderTests-857628909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8384466c-3615-4594-a0c9-baddc7eadc09 tempest-ProjectReaderTests-857628909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8384466c-3615-4594-a0c9-baddc7eadc09 tempest-ProjectReaderTests-857628909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8384466c-3615-4594-a0c9-baddc7eadc09 tempest-ProjectReaderTests-857628909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8384466c-3615-4594-a0c9-baddc7eadc09 tempest-ProjectReaderTests-857628909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8384466c-3615-4594-a0c9-baddc7eadc09 tempest-ProjectReaderTests-857628909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:50 devstack sudo[113714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:56:50 devstack sudo[113714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:50 devstack sudo[113714]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8384466c-3615-4594-a0c9-baddc7eadc09 tempest-ProjectReaderTests-857628909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.231s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:50 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-8384466c-3615-4594-a0c9-baddc7eadc09 tempest-ProjectReaderTests-857628909 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:56:50 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-8384466c-3615-4594-a0c9-baddc7eadc09 tempest-ProjectReaderTests-857628909 None] Deleted volume successfully. Aug 27 03:56:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8384466c-3615-4594-a0c9-baddc7eadc09 tempest-ProjectReaderTests-857628909 None] Lock "cinder-c8896f9c-e209-4950-be31-1415b1b2e44a-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Flow 'volume_create_manager' (59752628-85d9-468a-a2b2-ca5210e2019c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5e48c7-e081-4da2-b328-0cee5f1dbb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5e48c7-e081-4da2-b328-0cee5f1dbb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1287713101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4590ac31-9f00-4f73-b330-4b383071b45b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d8cbe1f77348419416c8952ebf70a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:51Z,use_quota=True,user_id='ef2dfd9efcb6474e9ec10f36b53b4acd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21bb389-93b3-4d11-95fc-f39ff95e33ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21bb389-93b3-4d11-95fc-f39ff95e33ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a86c3a8-941b-496c-aacd-202f8338fe4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a86c3a8-941b-496c-aacd-202f8338fe4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4590ac31-9f00-4f73-b330-4b383071b45b', 'volume_name': 'volume-4590ac31-9f00-4f73-b330-4b383071b45b', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1c620d-e4b3-42e9-9e0c-ad31ee2d7b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1c620d-e4b3-42e9-9e0c-ad31ee2d7b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5751e20-f8ea-4610-8566-54b7cfccfd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:51 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Volume 4590ac31-9f00-4f73-b330-4b383071b45b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4590ac31-9f00-4f73-b330-4b383071b45b', 'volume_size': 1} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1287713101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4590ac31-9f00-4f73-b330-4b383071b45b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d8cbe1f77348419416c8952ebf70a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:56:51Z,use_quota=True,user_id='ef2dfd9efcb6474e9ec10f36b53b4acd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Creating volume 4590ac31-9f00-4f73-b330-4b383071b45b {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:56:51 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4590ac31-9f00-4f73-b330-4b383071b45b 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:51 devstack sudo[113717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4590ac31-9f00-4f73-b330-4b383071b45b 1073741824 Aug 27 03:56:51 devstack sudo[113717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:51 devstack sudo[113717]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4590ac31-9f00-4f73-b330-4b383071b45b 1073741824" returned: 0 in 0.397s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4590ac31-9f00-4f73-b330-4b383071b45b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:51 devstack sudo[113723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4590ac31-9f00-4f73-b330-4b383071b45b Aug 27 03:56:51 devstack sudo[113723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:51 devstack sudo[113723]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4590ac31-9f00-4f73-b330-4b383071b45b" returned: 0 in 0.242s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5751e20-f8ea-4610-8566-54b7cfccfd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4590ac31-9f00-4f73-b330-4b383071b45b', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f64ba6-449f-40a0-a2aa-7e23bb08726b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:56:51 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Volume volume-4590ac31-9f00-4f73-b330-4b383071b45b (4590ac31-9f00-4f73-b330-4b383071b45b): created successfully Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f64ba6-449f-40a0-a2aa-7e23bb08726b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:56:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Flow 'volume_create_manager' (59752628-85d9-468a-a2b2-ca5210e2019c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:56:51 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-dbf3208c-e087-456e-b71f-a154828b1edf tempest-ProjectReaderTests-857628909 None] Created volume successfully. Aug 27 03:56:52 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1aa713fd-8b1a-4018-9825-5b95c98b04df tempest-ProjectReaderTests-857628909 None] Acquiring lock "cinder-4590ac31-9f00-4f73-b330-4b383071b45b-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:52 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1aa713fd-8b1a-4018-9825-5b95c98b04df tempest-ProjectReaderTests-857628909 None] Lock "cinder-4590ac31-9f00-4f73-b330-4b383071b45b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:52 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1aa713fd-8b1a-4018-9825-5b95c98b04df tempest-ProjectReaderTests-857628909 None] Acquiring lock "cinder-quobyte-4590ac31-9f00-4f73-b330-4b383071b45b" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:56:52 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1aa713fd-8b1a-4018-9825-5b95c98b04df tempest-ProjectReaderTests-857628909 None] Lock "cinder-quobyte-4590ac31-9f00-4f73-b330-4b383071b45b" acquired by "delete_volume" :: waited 0.013s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:56:52 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f70b73-22f5-4d49-b069-5be802f98825]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:56:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1aa713fd-8b1a-4018-9825-5b95c98b04df tempest-ProjectReaderTests-857628909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4590ac31-9f00-4f73-b330-4b383071b45b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:52 devstack sudo[113726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4590ac31-9f00-4f73-b330-4b383071b45b Aug 27 03:56:52 devstack sudo[113726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:52 devstack sudo[113726]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1aa713fd-8b1a-4018-9825-5b95c98b04df tempest-ProjectReaderTests-857628909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4590ac31-9f00-4f73-b330-4b383071b45b" returned: 0 in 0.330s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1aa713fd-8b1a-4018-9825-5b95c98b04df tempest-ProjectReaderTests-857628909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4590ac31-9f00-4f73-b330-4b383071b45b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:52 devstack sudo[113731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4590ac31-9f00-4f73-b330-4b383071b45b Aug 27 03:56:52 devstack sudo[113731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:52 devstack sudo[113731]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1aa713fd-8b1a-4018-9825-5b95c98b04df tempest-ProjectReaderTests-857628909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-4590ac31-9f00-4f73-b330-4b383071b45b" returned: 0 in 0.229s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:52 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1aa713fd-8b1a-4018-9825-5b95c98b04df tempest-ProjectReaderTests-857628909 None] Lock "cinder-quobyte-4590ac31-9f00-4f73-b330-4b383071b45b" released by "delete_volume" :: held 0.594s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:56:52 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-1aa713fd-8b1a-4018-9825-5b95c98b04df tempest-ProjectReaderTests-857628909 None] Created reservations ['5f723a71-c6e0-4e55-8f5f-c471810b9385', '7ef7dba8-d26c-4719-8b1a-67616b02c785', '3be99acd-d1d9-4ae1-9465-2a69525ca92a', 'b4628a04-7df1-4f2b-8f5f-731a80fda2cf'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:56:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1aa713fd-8b1a-4018-9825-5b95c98b04df tempest-ProjectReaderTests-857628909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:56:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1aa713fd-8b1a-4018-9825-5b95c98b04df tempest-ProjectReaderTests-857628909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:56:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1aa713fd-8b1a-4018-9825-5b95c98b04df tempest-ProjectReaderTests-857628909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:56:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1aa713fd-8b1a-4018-9825-5b95c98b04df tempest-ProjectReaderTests-857628909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:56:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1aa713fd-8b1a-4018-9825-5b95c98b04df tempest-ProjectReaderTests-857628909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:56:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1aa713fd-8b1a-4018-9825-5b95c98b04df tempest-ProjectReaderTests-857628909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:56:52 devstack sudo[113734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:56:52 devstack sudo[113734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:56:53 devstack sudo[113734]: pam_unix(sudo:session): session closed for user root Aug 27 03:56:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1aa713fd-8b1a-4018-9825-5b95c98b04df tempest-ProjectReaderTests-857628909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.231s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:56:53 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-1aa713fd-8b1a-4018-9825-5b95c98b04df tempest-ProjectReaderTests-857628909 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:56:53 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-1aa713fd-8b1a-4018-9825-5b95c98b04df tempest-ProjectReaderTests-857628909 None] Deleted volume successfully. Aug 27 03:56:53 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1aa713fd-8b1a-4018-9825-5b95c98b04df tempest-ProjectReaderTests-857628909 None] Lock "cinder-4590ac31-9f00-4f73-b330-4b383071b45b-delete_volume" released by "delete_volume" :: held 1.009s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:00 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Flow 'volume_create_manager' (bafa7647-5bb9-4f61-9e96-324a8c640b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32284698-b2db-4f62-860b-822070534627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32284698-b2db-4f62-860b-822070534627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2146168293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eebd8786-7876-420e-b784-05c6810c236f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ca47c7e2e664127981a057921c6de5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:01Z,use_quota=True,user_id='93bae3490d1c4a34bafff49f67827879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84cabd9-ef33-4279-af08-5fe09ef2229e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84cabd9-ef33-4279-af08-5fe09ef2229e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b7ae6d-0a0f-4bc3-a528-00e95a0b05d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b7ae6d-0a0f-4bc3-a528-00e95a0b05d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eebd8786-7876-420e-b784-05c6810c236f', 'volume_name': 'volume-eebd8786-7876-420e-b784-05c6810c236f', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e16d14-6095-42d8-a925-39fbfc464adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e16d14-6095-42d8-a925-39fbfc464adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a076278-a5ad-44e8-b42f-9c29e8781057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:00 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Volume eebd8786-7876-420e-b784-05c6810c236f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eebd8786-7876-420e-b784-05c6810c236f', 'volume_size': 1} Aug 27 03:57:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2146168293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eebd8786-7876-420e-b784-05c6810c236f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ca47c7e2e664127981a057921c6de5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:01Z,use_quota=True,user_id='93bae3490d1c4a34bafff49f67827879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Creating volume eebd8786-7876-420e-b784-05c6810c236f {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:00 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eebd8786-7876-420e-b784-05c6810c236f 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:01 devstack sudo[113739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eebd8786-7876-420e-b784-05c6810c236f 1073741824 Aug 27 03:57:01 devstack sudo[113739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:01 devstack sudo[113739]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eebd8786-7876-420e-b784-05c6810c236f 1073741824" returned: 0 in 0.412s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eebd8786-7876-420e-b784-05c6810c236f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:01 devstack sudo[113745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eebd8786-7876-420e-b784-05c6810c236f Aug 27 03:57:01 devstack sudo[113745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:01 devstack sudo[113745]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eebd8786-7876-420e-b784-05c6810c236f" returned: 0 in 0.229s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a076278-a5ad-44e8-b42f-9c29e8781057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eebd8786-7876-420e-b784-05c6810c236f', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d6941f-3e51-4c41-8783-6bd2bb95f9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:01 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Volume volume-eebd8786-7876-420e-b784-05c6810c236f (eebd8786-7876-420e-b784-05c6810c236f): created successfully Aug 27 03:57:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d6941f-3e51-4c41-8783-6bd2bb95f9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Flow 'volume_create_manager' (bafa7647-5bb9-4f61-9e96-324a8c640b04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:01 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-2e061e04-de85-4ddb-b154-a86f49fe770a tempest-ProjectReaderTests-312826391 None] Created volume successfully. Aug 27 03:57:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c81c40d6-efbd-4a82-82d2-f991108c0819 tempest-ProjectReaderTests-312826391 None] Acquiring lock "cinder-eebd8786-7876-420e-b784-05c6810c236f-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c81c40d6-efbd-4a82-82d2-f991108c0819 tempest-ProjectReaderTests-312826391 None] Lock "cinder-eebd8786-7876-420e-b784-05c6810c236f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c81c40d6-efbd-4a82-82d2-f991108c0819 tempest-ProjectReaderTests-312826391 None] Acquiring lock "cinder-quobyte-eebd8786-7876-420e-b784-05c6810c236f" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c81c40d6-efbd-4a82-82d2-f991108c0819 tempest-ProjectReaderTests-312826391 None] Lock "cinder-quobyte-eebd8786-7876-420e-b784-05c6810c236f" acquired by "delete_volume" :: waited 0.014s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:03 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6478bc4-f26e-40aa-841b-fecce047786f]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c81c40d6-efbd-4a82-82d2-f991108c0819 tempest-ProjectReaderTests-312826391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eebd8786-7876-420e-b784-05c6810c236f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:03 devstack sudo[113748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eebd8786-7876-420e-b784-05c6810c236f Aug 27 03:57:03 devstack sudo[113748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:03 devstack sudo[113748]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c81c40d6-efbd-4a82-82d2-f991108c0819 tempest-ProjectReaderTests-312826391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eebd8786-7876-420e-b784-05c6810c236f" returned: 0 in 0.341s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c81c40d6-efbd-4a82-82d2-f991108c0819 tempest-ProjectReaderTests-312826391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eebd8786-7876-420e-b784-05c6810c236f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:03 devstack sudo[113756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eebd8786-7876-420e-b784-05c6810c236f Aug 27 03:57:03 devstack sudo[113756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:03 devstack sudo[113756]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c81c40d6-efbd-4a82-82d2-f991108c0819 tempest-ProjectReaderTests-312826391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-eebd8786-7876-420e-b784-05c6810c236f" returned: 0 in 0.232s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c81c40d6-efbd-4a82-82d2-f991108c0819 tempest-ProjectReaderTests-312826391 None] Lock "cinder-quobyte-eebd8786-7876-420e-b784-05c6810c236f" released by "delete_volume" :: held 0.608s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:03 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-c81c40d6-efbd-4a82-82d2-f991108c0819 tempest-ProjectReaderTests-312826391 None] Created reservations ['848b307f-ee0a-49b4-9ac2-9b9346185629', '88d4973f-623e-4321-b714-845e39443ddd', '8f72f0a3-f7bc-4df7-b9f6-ec54fc3bb378', 'a587bda3-357e-4537-86ce-89c72943a070'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c81c40d6-efbd-4a82-82d2-f991108c0819 tempest-ProjectReaderTests-312826391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c81c40d6-efbd-4a82-82d2-f991108c0819 tempest-ProjectReaderTests-312826391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:03 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c81c40d6-efbd-4a82-82d2-f991108c0819 tempest-ProjectReaderTests-312826391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:03 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c81c40d6-efbd-4a82-82d2-f991108c0819 tempest-ProjectReaderTests-312826391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c81c40d6-efbd-4a82-82d2-f991108c0819 tempest-ProjectReaderTests-312826391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c81c40d6-efbd-4a82-82d2-f991108c0819 tempest-ProjectReaderTests-312826391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:03 devstack sudo[113759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:57:03 devstack sudo[113759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:04 devstack sudo[113759]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c81c40d6-efbd-4a82-82d2-f991108c0819 tempest-ProjectReaderTests-312826391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.269s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-c81c40d6-efbd-4a82-82d2-f991108c0819 tempest-ProjectReaderTests-312826391 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:57:04 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-c81c40d6-efbd-4a82-82d2-f991108c0819 tempest-ProjectReaderTests-312826391 None] Deleted volume successfully. Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c81c40d6-efbd-4a82-82d2-f991108c0819 tempest-ProjectReaderTests-312826391 None] Lock "cinder-eebd8786-7876-420e-b784-05c6810c236f-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Flow 'volume_create_manager' (520b0932-4d47-4ccf-8e32-8757b14cd6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (041bee21-952c-4c9f-b60c-1037525b673e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (041bee21-952c-4c9f-b60c-1037525b673e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-737396922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20deb007-32a8-4578-969f-855eb19a7b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ca47c7e2e664127981a057921c6de5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:05Z,use_quota=True,user_id='93bae3490d1c4a34bafff49f67827879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ae0e15-4f45-4774-8465-ef6a2e349a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ae0e15-4f45-4774-8465-ef6a2e349a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3012329f-53b8-4adb-9726-db256fe7a6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3012329f-53b8-4adb-9726-db256fe7a6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20deb007-32a8-4578-969f-855eb19a7b22', 'volume_name': 'volume-20deb007-32a8-4578-969f-855eb19a7b22', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987bc475-3e05-4f3e-865a-f491da0aca4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987bc475-3e05-4f3e-865a-f491da0aca4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ae16bb-64ab-4a68-9dbf-0e4c485532e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:04 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Volume 20deb007-32a8-4578-969f-855eb19a7b22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20deb007-32a8-4578-969f-855eb19a7b22', 'volume_size': 1} Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-737396922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20deb007-32a8-4578-969f-855eb19a7b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ca47c7e2e664127981a057921c6de5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:05Z,use_quota=True,user_id='93bae3490d1c4a34bafff49f67827879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Creating volume 20deb007-32a8-4578-969f-855eb19a7b22 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:04 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20deb007-32a8-4578-969f-855eb19a7b22 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:04 devstack sudo[113762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20deb007-32a8-4578-969f-855eb19a7b22 1073741824 Aug 27 03:57:04 devstack sudo[113762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:05 devstack sudo[113762]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20deb007-32a8-4578-969f-855eb19a7b22 1073741824" returned: 0 in 0.409s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20deb007-32a8-4578-969f-855eb19a7b22 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:05 devstack sudo[113768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20deb007-32a8-4578-969f-855eb19a7b22 Aug 27 03:57:05 devstack sudo[113768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:05 devstack sudo[113768]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20deb007-32a8-4578-969f-855eb19a7b22" returned: 0 in 0.234s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ae16bb-64ab-4a68-9dbf-0e4c485532e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20deb007-32a8-4578-969f-855eb19a7b22', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd15c8e2-792f-4e55-bb34-85497c316207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:05 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Volume volume-20deb007-32a8-4578-969f-855eb19a7b22 (20deb007-32a8-4578-969f-855eb19a7b22): created successfully Aug 27 03:57:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd15c8e2-792f-4e55-bb34-85497c316207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Flow 'volume_create_manager' (520b0932-4d47-4ccf-8e32-8757b14cd6e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:05 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-b6dff52b-9182-4317-9ea2-c412b36c1e8b tempest-ProjectReaderTests-312826391 None] Created volume successfully. Aug 27 03:57:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5c732b01-2f61-46c5-8deb-57638923faa8 tempest-ProjectReaderTests-312826391 None] Acquiring lock "cinder-20deb007-32a8-4578-969f-855eb19a7b22-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5c732b01-2f61-46c5-8deb-57638923faa8 tempest-ProjectReaderTests-312826391 None] Lock "cinder-20deb007-32a8-4578-969f-855eb19a7b22-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5c732b01-2f61-46c5-8deb-57638923faa8 tempest-ProjectReaderTests-312826391 None] Acquiring lock "cinder-quobyte-20deb007-32a8-4578-969f-855eb19a7b22" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5c732b01-2f61-46c5-8deb-57638923faa8 tempest-ProjectReaderTests-312826391 None] Lock "cinder-quobyte-20deb007-32a8-4578-969f-855eb19a7b22" acquired by "delete_volume" :: waited 0.013s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:05 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5600a4-b503-4551-822d-afcdf9e2631d]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5c732b01-2f61-46c5-8deb-57638923faa8 tempest-ProjectReaderTests-312826391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20deb007-32a8-4578-969f-855eb19a7b22 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:06 devstack sudo[113771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20deb007-32a8-4578-969f-855eb19a7b22 Aug 27 03:57:06 devstack sudo[113771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:06 devstack sudo[113771]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5c732b01-2f61-46c5-8deb-57638923faa8 tempest-ProjectReaderTests-312826391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20deb007-32a8-4578-969f-855eb19a7b22" returned: 0 in 0.359s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5c732b01-2f61-46c5-8deb-57638923faa8 tempest-ProjectReaderTests-312826391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20deb007-32a8-4578-969f-855eb19a7b22 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:06 devstack sudo[113776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20deb007-32a8-4578-969f-855eb19a7b22 Aug 27 03:57:06 devstack sudo[113776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:06 devstack sudo[113776]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5c732b01-2f61-46c5-8deb-57638923faa8 tempest-ProjectReaderTests-312826391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-20deb007-32a8-4578-969f-855eb19a7b22" returned: 0 in 0.248s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5c732b01-2f61-46c5-8deb-57638923faa8 tempest-ProjectReaderTests-312826391 None] Lock "cinder-quobyte-20deb007-32a8-4578-969f-855eb19a7b22" released by "delete_volume" :: held 0.642s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:06 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-5c732b01-2f61-46c5-8deb-57638923faa8 tempest-ProjectReaderTests-312826391 None] Created reservations ['dbac5177-2952-4b69-b93e-796d359ee12f', 'b8e68158-acef-4c95-b3fa-9e1c478fa068', 'c26a0b86-3201-4f1e-9657-fb056c17e877', '3fbdf965-7cd5-4108-bf85-5c1f10b6b058'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5c732b01-2f61-46c5-8deb-57638923faa8 tempest-ProjectReaderTests-312826391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5c732b01-2f61-46c5-8deb-57638923faa8 tempest-ProjectReaderTests-312826391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:06 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5c732b01-2f61-46c5-8deb-57638923faa8 tempest-ProjectReaderTests-312826391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:06 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5c732b01-2f61-46c5-8deb-57638923faa8 tempest-ProjectReaderTests-312826391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5c732b01-2f61-46c5-8deb-57638923faa8 tempest-ProjectReaderTests-312826391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5c732b01-2f61-46c5-8deb-57638923faa8 tempest-ProjectReaderTests-312826391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:06 devstack sudo[113779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:57:06 devstack sudo[113779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:06 devstack sudo[113779]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5c732b01-2f61-46c5-8deb-57638923faa8 tempest-ProjectReaderTests-312826391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.234s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:06 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-5c732b01-2f61-46c5-8deb-57638923faa8 tempest-ProjectReaderTests-312826391 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:57:06 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-5c732b01-2f61-46c5-8deb-57638923faa8 tempest-ProjectReaderTests-312826391 None] Deleted volume successfully. Aug 27 03:57:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5c732b01-2f61-46c5-8deb-57638923faa8 tempest-ProjectReaderTests-312826391 None] Lock "cinder-20deb007-32a8-4578-969f-855eb19a7b22-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:07 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Flow 'volume_create_manager' (719fc462-800d-451d-947a-3e4d7404fda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1046a77-bc0f-4507-ace8-4f07725ef857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1046a77-bc0f-4507-ace8-4f07725ef857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1342616836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c592f833-c4df-4d43-8e01-f74678332b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ca47c7e2e664127981a057921c6de5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:07Z,use_quota=True,user_id='93bae3490d1c4a34bafff49f67827879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c299f689-6918-4bb6-a290-319ff5becb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c299f689-6918-4bb6-a290-319ff5becb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a005678-534f-408c-b4fb-e42e9588b88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a005678-534f-408c-b4fb-e42e9588b88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c592f833-c4df-4d43-8e01-f74678332b31', 'volume_name': 'volume-c592f833-c4df-4d43-8e01-f74678332b31', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70065ccc-e8cf-496d-a5a9-b154fa10a65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70065ccc-e8cf-496d-a5a9-b154fa10a65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32fe92af-d3e7-41cd-801c-757bd04a1ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:07 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Volume c592f833-c4df-4d43-8e01-f74678332b31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c592f833-c4df-4d43-8e01-f74678332b31', 'volume_size': 1} Aug 27 03:57:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1342616836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c592f833-c4df-4d43-8e01-f74678332b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ca47c7e2e664127981a057921c6de5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:07Z,use_quota=True,user_id='93bae3490d1c4a34bafff49f67827879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Creating volume c592f833-c4df-4d43-8e01-f74678332b31 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:07 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c592f833-c4df-4d43-8e01-f74678332b31 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:07 devstack sudo[113782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c592f833-c4df-4d43-8e01-f74678332b31 1073741824 Aug 27 03:57:07 devstack sudo[113782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:07 devstack sudo[113782]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c592f833-c4df-4d43-8e01-f74678332b31 1073741824" returned: 0 in 0.395s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c592f833-c4df-4d43-8e01-f74678332b31 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:07 devstack sudo[113788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c592f833-c4df-4d43-8e01-f74678332b31 Aug 27 03:57:07 devstack sudo[113788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:08 devstack sudo[113788]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c592f833-c4df-4d43-8e01-f74678332b31" returned: 0 in 0.231s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:08 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] <== create_volume: return (662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32fe92af-d3e7-41cd-801c-757bd04a1ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c592f833-c4df-4d43-8e01-f74678332b31', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a343885d-ab27-4a42-9ad2-4cb84457a578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:08 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Volume volume-c592f833-c4df-4d43-8e01-f74678332b31 (c592f833-c4df-4d43-8e01-f74678332b31): created successfully Aug 27 03:57:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a343885d-ab27-4a42-9ad2-4cb84457a578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Flow 'volume_create_manager' (719fc462-800d-451d-947a-3e4d7404fda5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:08 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-6525ac88-13eb-471b-ac2e-519e3c758a60 tempest-ProjectReaderTests-312826391 None] Created volume successfully. Aug 27 03:57:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b85fdac2-276d-4cff-87cf-836df9063b04 tempest-ProjectReaderTests-312826391 None] Acquiring lock "cinder-c592f833-c4df-4d43-8e01-f74678332b31-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b85fdac2-276d-4cff-87cf-836df9063b04 tempest-ProjectReaderTests-312826391 None] Lock "cinder-c592f833-c4df-4d43-8e01-f74678332b31-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b85fdac2-276d-4cff-87cf-836df9063b04 tempest-ProjectReaderTests-312826391 None] Acquiring lock "cinder-quobyte-c592f833-c4df-4d43-8e01-f74678332b31" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b85fdac2-276d-4cff-87cf-836df9063b04 tempest-ProjectReaderTests-312826391 None] Lock "cinder-quobyte-c592f833-c4df-4d43-8e01-f74678332b31" acquired by "delete_volume" :: waited 0.014s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:08 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[f492e109-4adc-4356-bac1-c1c9262b8f83]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b85fdac2-276d-4cff-87cf-836df9063b04 tempest-ProjectReaderTests-312826391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c592f833-c4df-4d43-8e01-f74678332b31 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:08 devstack sudo[113791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c592f833-c4df-4d43-8e01-f74678332b31 Aug 27 03:57:08 devstack sudo[113791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:08 devstack sudo[113791]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b85fdac2-276d-4cff-87cf-836df9063b04 tempest-ProjectReaderTests-312826391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c592f833-c4df-4d43-8e01-f74678332b31" returned: 0 in 0.343s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b85fdac2-276d-4cff-87cf-836df9063b04 tempest-ProjectReaderTests-312826391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c592f833-c4df-4d43-8e01-f74678332b31 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:08 devstack sudo[113796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c592f833-c4df-4d43-8e01-f74678332b31 Aug 27 03:57:08 devstack sudo[113796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:09 devstack sudo[113796]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b85fdac2-276d-4cff-87cf-836df9063b04 tempest-ProjectReaderTests-312826391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c592f833-c4df-4d43-8e01-f74678332b31" returned: 0 in 0.249s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b85fdac2-276d-4cff-87cf-836df9063b04 tempest-ProjectReaderTests-312826391 None] Lock "cinder-quobyte-c592f833-c4df-4d43-8e01-f74678332b31" released by "delete_volume" :: held 0.628s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:09 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-b85fdac2-276d-4cff-87cf-836df9063b04 tempest-ProjectReaderTests-312826391 None] Created reservations ['b8058bd2-d31b-4794-a014-4187bc625c08', 'fa26ba63-fc58-411c-a07a-fa8c41e22055', 'a619848d-4c7d-4325-8e7f-8e29b0e922ff', '0e11504e-746e-4c2e-bb03-c64cefab513b'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b85fdac2-276d-4cff-87cf-836df9063b04 tempest-ProjectReaderTests-312826391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b85fdac2-276d-4cff-87cf-836df9063b04 tempest-ProjectReaderTests-312826391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b85fdac2-276d-4cff-87cf-836df9063b04 tempest-ProjectReaderTests-312826391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b85fdac2-276d-4cff-87cf-836df9063b04 tempest-ProjectReaderTests-312826391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b85fdac2-276d-4cff-87cf-836df9063b04 tempest-ProjectReaderTests-312826391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b85fdac2-276d-4cff-87cf-836df9063b04 tempest-ProjectReaderTests-312826391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:09 devstack sudo[113799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:57:09 devstack sudo[113799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:09 devstack sudo[113799]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b85fdac2-276d-4cff-87cf-836df9063b04 tempest-ProjectReaderTests-312826391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.240s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:09 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-b85fdac2-276d-4cff-87cf-836df9063b04 tempest-ProjectReaderTests-312826391 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:57:09 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-b85fdac2-276d-4cff-87cf-836df9063b04 tempest-ProjectReaderTests-312826391 None] Deleted volume successfully. Aug 27 03:57:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-b85fdac2-276d-4cff-87cf-836df9063b04 tempest-ProjectReaderTests-312826391 None] Lock "cinder-c592f833-c4df-4d43-8e01-f74678332b31-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Flow 'volume_create_manager' (46faf304-8f6d-4fe4-a4c4-fdeb04f0c003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63011b93-4b8a-4a21-8acc-59ba59dd9a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63011b93-4b8a-4a21-8acc-59ba59dd9a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1698397876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db269dd7-781e-4030-8fbb-cc2401bedc90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ca47c7e2e664127981a057921c6de5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:10Z,use_quota=True,user_id='93bae3490d1c4a34bafff49f67827879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc3a20d4-b55d-4129-b462-f4ffc92a20c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc3a20d4-b55d-4129-b462-f4ffc92a20c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add004df-c981-4ee1-8487-aebe0aaafb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add004df-c981-4ee1-8487-aebe0aaafb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db269dd7-781e-4030-8fbb-cc2401bedc90', 'volume_name': 'volume-db269dd7-781e-4030-8fbb-cc2401bedc90', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0478686c-a1e7-444d-8f48-c2a9415d391b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0478686c-a1e7-444d-8f48-c2a9415d391b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b58dcdb-3bb0-45e8-a17c-201cba34150a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:10 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Volume db269dd7-781e-4030-8fbb-cc2401bedc90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db269dd7-781e-4030-8fbb-cc2401bedc90', 'volume_size': 1} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1698397876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db269dd7-781e-4030-8fbb-cc2401bedc90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ca47c7e2e664127981a057921c6de5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:10Z,use_quota=True,user_id='93bae3490d1c4a34bafff49f67827879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Creating volume db269dd7-781e-4030-8fbb-cc2401bedc90 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:10 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-db269dd7-781e-4030-8fbb-cc2401bedc90 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:10 devstack sudo[113802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-db269dd7-781e-4030-8fbb-cc2401bedc90 1073741824 Aug 27 03:57:10 devstack sudo[113802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:10 devstack sudo[113802]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-db269dd7-781e-4030-8fbb-cc2401bedc90 1073741824" returned: 0 in 0.393s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-db269dd7-781e-4030-8fbb-cc2401bedc90 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:10 devstack sudo[113807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-db269dd7-781e-4030-8fbb-cc2401bedc90 Aug 27 03:57:10 devstack sudo[113807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:10 devstack sudo[113807]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-db269dd7-781e-4030-8fbb-cc2401bedc90" returned: 0 in 0.233s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] <== create_volume: return (665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b58dcdb-3bb0-45e8-a17c-201cba34150a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db269dd7-781e-4030-8fbb-cc2401bedc90', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f2b51c-ebca-4384-b1f5-08f496558741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:10 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Volume volume-db269dd7-781e-4030-8fbb-cc2401bedc90 (db269dd7-781e-4030-8fbb-cc2401bedc90): created successfully Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f2b51c-ebca-4384-b1f5-08f496558741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:10 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Flow 'volume_create_manager' (46faf304-8f6d-4fe4-a4c4-fdeb04f0c003) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:10 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-8b3be10a-c20d-4873-bebc-b93bee1b6e22 tempest-ProjectReaderTests-312826391 None] Created volume successfully. Aug 27 03:57:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-79f4cbc2-4ffb-4d4f-bdc0-8826c588eac6 tempest-ProjectReaderTests-312826391 None] Acquiring lock "cinder-db269dd7-781e-4030-8fbb-cc2401bedc90-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-79f4cbc2-4ffb-4d4f-bdc0-8826c588eac6 tempest-ProjectReaderTests-312826391 None] Lock "cinder-db269dd7-781e-4030-8fbb-cc2401bedc90-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-79f4cbc2-4ffb-4d4f-bdc0-8826c588eac6 tempest-ProjectReaderTests-312826391 None] Acquiring lock "cinder-quobyte-db269dd7-781e-4030-8fbb-cc2401bedc90" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-79f4cbc2-4ffb-4d4f-bdc0-8826c588eac6 tempest-ProjectReaderTests-312826391 None] Lock "cinder-quobyte-db269dd7-781e-4030-8fbb-cc2401bedc90" acquired by "delete_volume" :: waited 0.014s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:11 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[09aab64b-0fe6-4f7c-94a3-f4421465477f]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-79f4cbc2-4ffb-4d4f-bdc0-8826c588eac6 tempest-ProjectReaderTests-312826391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-db269dd7-781e-4030-8fbb-cc2401bedc90 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:11 devstack sudo[113810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-db269dd7-781e-4030-8fbb-cc2401bedc90 Aug 27 03:57:11 devstack sudo[113810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:11 devstack sudo[113810]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-79f4cbc2-4ffb-4d4f-bdc0-8826c588eac6 tempest-ProjectReaderTests-312826391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-db269dd7-781e-4030-8fbb-cc2401bedc90" returned: 0 in 0.337s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-79f4cbc2-4ffb-4d4f-bdc0-8826c588eac6 tempest-ProjectReaderTests-312826391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-db269dd7-781e-4030-8fbb-cc2401bedc90 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:11 devstack sudo[113815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-db269dd7-781e-4030-8fbb-cc2401bedc90 Aug 27 03:57:11 devstack sudo[113815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:11 devstack sudo[113815]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-79f4cbc2-4ffb-4d4f-bdc0-8826c588eac6 tempest-ProjectReaderTests-312826391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-db269dd7-781e-4030-8fbb-cc2401bedc90" returned: 0 in 0.253s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-79f4cbc2-4ffb-4d4f-bdc0-8826c588eac6 tempest-ProjectReaderTests-312826391 None] Lock "cinder-quobyte-db269dd7-781e-4030-8fbb-cc2401bedc90" released by "delete_volume" :: held 0.626s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:11 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-79f4cbc2-4ffb-4d4f-bdc0-8826c588eac6 tempest-ProjectReaderTests-312826391 None] Created reservations ['92ce521b-4727-400a-b660-d178c30e3871', 'e39db700-f75a-4477-b7fb-ba78e12d5e75', '3eda0e3b-3c76-4004-b6cd-c76fb0b18a50', '5563b555-d8b9-4760-a8f8-a060069ca7ac'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-79f4cbc2-4ffb-4d4f-bdc0-8826c588eac6 tempest-ProjectReaderTests-312826391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-79f4cbc2-4ffb-4d4f-bdc0-8826c588eac6 tempest-ProjectReaderTests-312826391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-79f4cbc2-4ffb-4d4f-bdc0-8826c588eac6 tempest-ProjectReaderTests-312826391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-79f4cbc2-4ffb-4d4f-bdc0-8826c588eac6 tempest-ProjectReaderTests-312826391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-79f4cbc2-4ffb-4d4f-bdc0-8826c588eac6 tempest-ProjectReaderTests-312826391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-79f4cbc2-4ffb-4d4f-bdc0-8826c588eac6 tempest-ProjectReaderTests-312826391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:11 devstack sudo[113818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:57:11 devstack sudo[113818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:12 devstack sudo[113818]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-79f4cbc2-4ffb-4d4f-bdc0-8826c588eac6 tempest-ProjectReaderTests-312826391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.244s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:12 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-79f4cbc2-4ffb-4d4f-bdc0-8826c588eac6 tempest-ProjectReaderTests-312826391 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:57:12 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-79f4cbc2-4ffb-4d4f-bdc0-8826c588eac6 tempest-ProjectReaderTests-312826391 None] Deleted volume successfully. Aug 27 03:57:12 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-79f4cbc2-4ffb-4d4f-bdc0-8826c588eac6 tempest-ProjectReaderTests-312826391 None] Lock "cinder-db269dd7-781e-4030-8fbb-cc2401bedc90-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:14 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:57:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:14 devstack sudo[113822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:57:14 devstack sudo[113822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:15 devstack sudo[113822]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.253s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:57:15 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager._thread_info {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:57:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread count: 28 {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 03:57:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread info: [<_MainThread(MainThread, started 134250325188736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 03:57:21 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=130,cinder:UPDATE=185,cinder:INSERT=43,cinder:DELETE=16 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:57:22 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=117,cinder:UPDATE=205,cinder:INSERT=46,cinder:DELETE=19 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Flow 'volume_create_manager' (48c175e1-0ec9-41bf-8f68-68e36b67b7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79cadb06-64bb-4a91-aa1d-2277ed12dd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Flow 'volume_create_manager' (79382a05-550e-4d33-affe-61bb28a59203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (314aa598-e992-44ea-986e-adcf1ce9c5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79cadb06-64bb-4a91-aa1d-2277ed12dd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1736785378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d3444f-ec0d-4663-bbc4-5d9d6455071d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b516f5f50894efe9e0dae164db282f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:24Z,use_quota=True,user_id='047b328947724678b8346e34d555b8a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c372320-9edf-463b-aad1-995904ecc85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c372320-9edf-463b-aad1-995904ecc85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e927d919-4b0a-4806-ac28-d790e5717179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e927d919-4b0a-4806-ac28-d790e5717179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4d3444f-ec0d-4663-bbc4-5d9d6455071d', 'volume_name': 'volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (859b8a6b-081b-4f06-a37e-e71be5bf8160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (859b8a6b-081b-4f06-a37e-e71be5bf8160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704fdff7-9e75-48f7-a1ad-e8ffa7a9968a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:24 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Volume f4d3444f-ec0d-4663-bbc4-5d9d6455071d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d', 'volume_size': 1} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1736785378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d3444f-ec0d-4663-bbc4-5d9d6455071d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b516f5f50894efe9e0dae164db282f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:24Z,use_quota=True,user_id='047b328947724678b8346e34d555b8a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Creating volume f4d3444f-ec0d-4663-bbc4-5d9d6455071d {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:24 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (314aa598-e992-44ea-986e-adcf1ce9c5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-559860227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b6c2a56-886f-4aca-a95d-95ff56f57576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c750d918188048b5b214288265cd12e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:24Z,use_quota=True,user_id='26979494902b4919b4e50a88045cc58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:24 devstack sudo[113899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d 1073741824 Aug 27 03:57:24 devstack sudo[113899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee38996-99da-4530-990c-04e2033b309d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee38996-99da-4530-990c-04e2033b309d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04bcc87e-cd04-49d0-bac8-2a38ad472ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04bcc87e-cd04-49d0-bac8-2a38ad472ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b6c2a56-886f-4aca-a95d-95ff56f57576', 'volume_name': 'volume-7b6c2a56-886f-4aca-a95d-95ff56f57576', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb76d77e-20a5-40bb-a9bb-a5f95c745477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb76d77e-20a5-40bb-a9bb-a5f95c745477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e7b482-6c82-4015-a4a6-7fa19e3d1a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:24 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Volume 7b6c2a56-886f-4aca-a95d-95ff56f57576: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b6c2a56-886f-4aca-a95d-95ff56f57576', 'volume_size': 1} Aug 27 03:57:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:25 devstack sudo[113899]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d 1073741824" returned: 0 in 0.538s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Flow 'volume_create_manager' (486e4021-11cc-44e2-870b-d5d99aa1b4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7892440f-092a-4788-a735-ac77fc59fe13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7892440f-092a-4788-a735-ac77fc59fe13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-207877082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ef5a89-4433-4beb-852f-5961daeb44bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8658e7bcb5964a65a4672729d843a24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:25Z,use_quota=True,user_id='d1b1c78558e94e16b33cfaf2594e5ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b5d367-7276-46dd-81d6-36fc767a3953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b5d367-7276-46dd-81d6-36fc767a3953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f814294-f1a1-4e06-85bd-d348df9b5288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f814294-f1a1-4e06-85bd-d348df9b5288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62ef5a89-4433-4beb-852f-5961daeb44bf', 'volume_name': 'volume-62ef5a89-4433-4beb-852f-5961daeb44bf', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b6bf443-72ee-42f5-81e6-ac1717934fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b6bf443-72ee-42f5-81e6-ac1717934fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42345184-a359-407d-809f-7f3f7c12ed01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:25 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Volume 62ef5a89-4433-4beb-852f-5961daeb44bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62ef5a89-4433-4beb-852f-5961daeb44bf', 'volume_size': 1} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:25 devstack sudo[113905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d Aug 27 03:57:25 devstack sudo[113905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:25 devstack sudo[113905]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d" returned: 0 in 0.242s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.839s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-559860227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b6c2a56-886f-4aca-a95d-95ff56f57576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c750d918188048b5b214288265cd12e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:24Z,use_quota=True,user_id='26979494902b4919b4e50a88045cc58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Creating volume 7b6c2a56-886f-4aca-a95d-95ff56f57576 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:25 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7b6c2a56-886f-4aca-a95d-95ff56f57576 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704fdff7-9e75-48f7-a1ad-e8ffa7a9968a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:25 devstack sudo[113911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7b6c2a56-886f-4aca-a95d-95ff56f57576 1073741824 Aug 27 03:57:25 devstack sudo[113911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff96a4c5-5a8a-48ab-adfc-0c7ac2831a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:25 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Volume volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d (f4d3444f-ec0d-4663-bbc4-5d9d6455071d): created successfully Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff96a4c5-5a8a-48ab-adfc-0c7ac2831a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Flow 'volume_create_manager' (48c175e1-0ec9-41bf-8f68-68e36b67b7d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:25 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-15268442-c7ea-4550-8a63-0f062cd64298 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Created volume successfully. Aug 27 03:57:25 devstack sudo[113911]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7b6c2a56-886f-4aca-a95d-95ff56f57576 1073741824" returned: 0 in 0.429s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7b6c2a56-886f-4aca-a95d-95ff56f57576 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:26 devstack sudo[113920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7b6c2a56-886f-4aca-a95d-95ff56f57576 Aug 27 03:57:26 devstack sudo[113920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:26 devstack sudo[113920]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7b6c2a56-886f-4aca-a95d-95ff56f57576" returned: 0 in 0.263s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:26 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.014s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:26 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-207877082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ef5a89-4433-4beb-852f-5961daeb44bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8658e7bcb5964a65a4672729d843a24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:25Z,use_quota=True,user_id='d1b1c78558e94e16b33cfaf2594e5ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:26 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Creating volume 62ef5a89-4433-4beb-852f-5961daeb44bf {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:26 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:26 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:26 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:26 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e7b482-6c82-4015-a4a6-7fa19e3d1a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b6c2a56-886f-4aca-a95d-95ff56f57576', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f18d50-21ab-446b-b549-dc557c455138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:26 devstack sudo[113923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf 1073741824 Aug 27 03:57:26 devstack sudo[113923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:26 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Volume volume-7b6c2a56-886f-4aca-a95d-95ff56f57576 (7b6c2a56-886f-4aca-a95d-95ff56f57576): created successfully Aug 27 03:57:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f18d50-21ab-446b-b549-dc557c455138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:26 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Flow 'volume_create_manager' (79382a05-550e-4d33-affe-61bb28a59203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:26 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-b9fefd32-60ab-4607-aea2-4d640496e41e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Created volume successfully. Aug 27 03:57:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-70489804-b1e6-4cad-b82e-03a0c12545cd tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:26 devstack sudo[113923]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf 1073741824" returned: 0 in 0.463s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:26 devstack sudo[113929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf Aug 27 03:57:26 devstack sudo[113929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:27 devstack sudo[113929]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf" returned: 0 in 0.243s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-70489804-b1e6-4cad-b82e-03a0c12545cd tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.536s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-70489804-b1e6-4cad-b82e-03a0c12545cd tempest-CreateVolumesFromSnapshotTest-1966912875 None] Creating offline snapshot e2eea03c-4a3c-4b4e-860f-a793ec49c0fa of volume f4d3444f-ec0d-4663-bbc4-5d9d6455071d {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:57:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42345184-a359-407d-809f-7f3f7c12ed01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62ef5a89-4433-4beb-852f-5961daeb44bf', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d63e01b-494b-4fcd-bd35-1d0e03333545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:27 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebb0741-93f9-4832-a6a1-2c8871803360]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-70489804-b1e6-4cad-b82e-03a0c12545cd tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:27 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Volume volume-62ef5a89-4433-4beb-852f-5961daeb44bf (62ef5a89-4433-4beb-852f-5961daeb44bf): created successfully Aug 27 03:57:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d63e01b-494b-4fcd-bd35-1d0e03333545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Flow 'volume_create_manager' (486e4021-11cc-44e2-870b-d5d99aa1b4bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:27 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-a174c0d2-f575-49e6-a70c-28a618da03d5 tempest-ProjectMemberTests-1426758417 None] Created volume successfully. Aug 27 03:57:27 devstack sudo[113932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d Aug 27 03:57:27 devstack sudo[113932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:27 devstack sudo[113932]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-70489804-b1e6-4cad-b82e-03a0c12545cd tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d" returned: 0 in 0.434s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-70489804-b1e6-4cad-b82e-03a0c12545cd tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.e2eea03c-4a3c-4b4e-860f-a793ec49c0fa 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:27 devstack sudo[113937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.e2eea03c-4a3c-4b4e-860f-a793ec49c0fa 1G Aug 27 03:57:27 devstack sudo[113937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b51292e2-0851-4e68-93d0-234d38545514 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:28 devstack sudo[113937]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-70489804-b1e6-4cad-b82e-03a0c12545cd tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.e2eea03c-4a3c-4b4e-860f-a793ec49c0fa 1G" returned: 0 in 0.521s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-70489804-b1e6-4cad-b82e-03a0c12545cd tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.e2eea03c-4a3c-4b4e-860f-a793ec49c0fa {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:28 devstack sudo[113946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.e2eea03c-4a3c-4b4e-860f-a793ec49c0fa Aug 27 03:57:28 devstack sudo[113946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:28 devstack sudo[113946]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-70489804-b1e6-4cad-b82e-03a0c12545cd tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.e2eea03c-4a3c-4b4e-860f-a793ec49c0fa" returned: 0 in 0.416s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:28 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-70489804-b1e6-4cad-b82e-03a0c12545cd tempest-CreateVolumesFromSnapshotTest-1966912875 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.e2eea03c-4a3c-4b4e-860f-a793ec49c0fa is being set with open permissions: ugo+rw Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-70489804-b1e6-4cad-b82e-03a0c12545cd tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.e2eea03c-4a3c-4b4e-860f-a793ec49c0fa {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:28 devstack sudo[113952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.e2eea03c-4a3c-4b4e-860f-a793ec49c0fa Aug 27 03:57:28 devstack sudo[113952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Flow 'volume_create_manager' (e1251005-6d74-4643-8216-36661da7babb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba88155f-3da3-49e2-8a86-083a6188f6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Flow 'volume_create_manager' (7693f505-2d8e-4728-94c0-5693fc109f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8986cbf3-55e0-4c11-bd62-85650584de8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba88155f-3da3-49e2-8a86-083a6188f6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b79e6294-ff52-4af8-a011-7dd4630a5b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4de75533c594456b731830a01a33a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:28Z,use_quota=True,user_id='76ce48f5bb7742eb95eb1e4865fcb5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b8625a1-6f26-4732-ba44-e033c2e51f7f),volume_type_id=8b8625a1-6f26-4732-ba44-e033c2e51f7f)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b04f0430-427e-40b6-8f62-a9c9ed8bdeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b04f0430-427e-40b6-8f62-a9c9ed8bdeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e61b854c-c6fb-4360-abf6-cf0e8fd3db71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.image.glance [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Creating Keystone auth plugin from conf {{(pid=94328) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8986cbf3-55e0-4c11-bd62-85650584de8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-652423726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9eee4b-0410-4c9a-955f-5cae73925bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c750d918188048b5b214288265cd12e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:28Z,use_quota=True,user_id='26979494902b4919b4e50a88045cc58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7013afc-55b8-468a-860c-39be15f38820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7013afc-55b8-468a-860c-39be15f38820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06ee66f-f134-4fed-933f-6c5e779d4bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06ee66f-f134-4fed-933f-6c5e779d4bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df9eee4b-0410-4c9a-955f-5cae73925bac', 'volume_name': 'volume-df9eee4b-0410-4c9a-955f-5cae73925bac', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (195760cf-5182-4236-b05c-1ff93fbfd6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (195760cf-5182-4236-b05c-1ff93fbfd6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf99166-5065-416f-bc14-d0b53ec6fe9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:28 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Volume df9eee4b-0410-4c9a-955f-5cae73925bac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df9eee4b-0410-4c9a-955f-5cae73925bac', 'volume_size': 1} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Flow 'volume_create_manager' (8ff7b18d-d958-4eae-a63d-d2b015a1d00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96636bcd-ec0d-4d5f-b66b-9affdd374983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96636bcd-ec0d-4d5f-b66b-9affdd374983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1060682629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=291f6dbd-2940-4c07-9569-ab172fd3296b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c750d918188048b5b214288265cd12e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:29Z,use_quota=True,user_id='26979494902b4919b4e50a88045cc58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342b5b1d-ade2-45c3-bd89-37b52b475827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342b5b1d-ade2-45c3-bd89-37b52b475827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ccd9fed-9350-42d0-b74d-4e8e087d3d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ccd9fed-9350-42d0-b74d-4e8e087d3d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '291f6dbd-2940-4c07-9569-ab172fd3296b', 'volume_name': 'volume-291f6dbd-2940-4c07-9569-ab172fd3296b', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad74ff34-a860-48a6-a80e-d1f93ebef8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad74ff34-a860-48a6-a80e-d1f93ebef8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:28 devstack sudo[113952]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d61c3fa2-28ae-4aef-9d8b-38d44660e606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:28 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Volume 291f6dbd-2940-4c07-9569-ab172fd3296b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-291f6dbd-2940-4c07-9569-ab172fd3296b', 'volume_size': 1} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-70489804-b1e6-4cad-b82e-03a0c12545cd tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.e2eea03c-4a3c-4b4e-860f-a793ec49c0fa" returned: 0 in 0.386s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-70489804-b1e6-4cad-b82e-03a0c12545cd tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:28 devstack sudo[113955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.info Aug 27 03:57:28 devstack sudo[113955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Flow 'volume_create_manager' (345441eb-7bbe-47be-9eec-92418c57ce5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c055c190-d915-4891-a55b-51a9dbf55264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e61b854c-c6fb-4360-abf6-cf0e8fd3db71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b79e6294-ff52-4af8-a011-7dd4630a5b4c', 'volume_name': 'volume-b79e6294-ff52-4af8-a011-7dd4630a5b4c', 'volume_size': 1, 'image_id': 'fa3887d4-53be-4575-b288-8269d93376cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa3887d4-53be-4575-b288-8269d93376cd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c2fcc3f8fcd68a603d0bb63a15cd58ca', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e4de75533c594456b731830a01a33a21', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3e8d22c1c7601763c57a3784833bb3918db5071d0077871e5ff9c851f8db2f9770d150884b641737c2bf1ccfd605f3f52166140a67c0f092d95c706a3f633863', 'id': 'fa3887d4-53be-4575-b288-8269d93376cd', 'created_at': datetime.datetime(2026, 8, 27, 1, 57, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 57, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa3887d4-53be-4575-b288-8269d93376cd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fc6ea2-eaea-41fa-b473-1f17a70af382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fc6ea2-eaea-41fa-b473-1f17a70af382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a13b1d2-4a72-4f98-85a0-cf753b45f2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:29 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Volume b79e6294-ff52-4af8-a011-7dd4630a5b4c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b79e6294-ff52-4af8-a011-7dd4630a5b4c', 'volume_size': 1, 'image_id': 'fa3887d4-53be-4575-b288-8269d93376cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa3887d4-53be-4575-b288-8269d93376cd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c2fcc3f8fcd68a603d0bb63a15cd58ca', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e4de75533c594456b731830a01a33a21', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3e8d22c1c7601763c57a3784833bb3918db5071d0077871e5ff9c851f8db2f9770d150884b641737c2bf1ccfd605f3f52166140a67c0f092d95c706a3f633863', 'id': 'fa3887d4-53be-4575-b288-8269d93376cd', 'created_at': datetime.datetime(2026, 8, 27, 1, 57, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 57, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa3887d4-53be-4575-b288-8269d93376cd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Trying to clone b79e6294-ff52-4af8-a011-7dd4630a5b4c from image fa3887d4-53be-4575-b288-8269d93376cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/fa3887d4-53be-4575-b288-8269d93376cd', 'metadata': {}}]). {{(pid=94328) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c055c190-d915-4891-a55b-51a9dbf55264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1337965009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c750d918188048b5b214288265cd12e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:29Z,use_quota=True,user_id='26979494902b4919b4e50a88045cc58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbd8007-9c5c-4071-9036-de1f78fa8c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbd8007-9c5c-4071-9036-de1f78fa8c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df57815-001d-4388-8844-3fe495e73f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df57815-001d-4388-8844-3fe495e73f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac', 'volume_name': 'volume-8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b2d0e3-065c-4ae6-ac35-0b87f79df0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b2d0e3-065c-4ae6-ac35-0b87f79df0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785c5e21-4c65-404b-a1d0-13b875bbdcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:29 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Volume 8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac', 'volume_size': 1} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:29 devstack sudo[113955]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-70489804-b1e6-4cad-b82e-03a0c12545cd tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.info" returned: 0 in 0.314s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:29 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-70489804-b1e6-4cad-b82e-03a0c12545cd tempest-CreateVolumesFromSnapshotTest-1966912875 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.info is being set with open permissions: ugo+rw Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-70489804-b1e6-4cad-b82e-03a0c12545cd tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:29 devstack sudo[113958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.info Aug 27 03:57:29 devstack sudo[113958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 27 03:57:29 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Image download 0.00 MB at 0.00 MB/s Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf96d82-79ca-4b07-82c7-5f3ebcf7e75a]: (4, 'raw') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:29 devstack sudo[113960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD Aug 27 03:57:29 devstack sudo[113960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Flow 'volume_create_manager' (f47db984-8769-40d7-95f1-a2d08150e5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb41353b-696d-4012-a1ec-cd9da7014012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb41353b-696d-4012-a1ec-cd9da7014012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1819804735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51c9aeb4-8271-4e3e-ab9e-7fe71b763860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c750d918188048b5b214288265cd12e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:29Z,use_quota=True,user_id='26979494902b4919b4e50a88045cc58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1764e011-e1e7-4278-ad68-ff433f866ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1764e011-e1e7-4278-ad68-ff433f866ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:29 devstack sudo[113958]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e1c0b1-f9d7-4f3a-9a90-0d144e9fcdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e1c0b1-f9d7-4f3a-9a90-0d144e9fcdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51c9aeb4-8271-4e3e-ab9e-7fe71b763860', 'volume_name': 'volume-51c9aeb4-8271-4e3e-ab9e-7fe71b763860', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8790890-47b8-46de-b279-abf1cb9f608d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8790890-47b8-46de-b279-abf1cb9f608d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02660d5-0507-4abe-9451-f6ce005a5731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:29 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Volume 51c9aeb4-8271-4e3e-ab9e-7fe71b763860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51c9aeb4-8271-4e3e-ab9e-7fe71b763860', 'volume_size': 1} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-70489804-b1e6-4cad-b82e-03a0c12545cd tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.info" returned: 0 in 0.381s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-70489804-b1e6-4cad-b82e-03a0c12545cd tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.562s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b51292e2-0851-4e68-93d0-234d38545514 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.997s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-b51292e2-0851-4e68-93d0-234d38545514 tempest-ProjectMemberTests-1426758417 None] Creating offline snapshot e9b1bbf5-0f92-41f1-8ca5-64d58012f825 of volume 62ef5a89-4433-4beb-852f-5961daeb44bf {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ab73de-75aa-4c0a-8fdf-1284b67f5ea3]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b51292e2-0851-4e68-93d0-234d38545514 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:29 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-70489804-b1e6-4cad-b82e-03a0c12545cd tempest-CreateVolumesFromSnapshotTest-1966912875 None] Create snapshot completed successfully Aug 27 03:57:29 devstack sudo[113960]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:29 devstack sudo[113963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD" returned: 0 in 0.492s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:29 devstack sudo[113963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Flow 'volume_create_manager' (62813743-9c7b-46e1-9210-7530b6016987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13a82fe4-4c3e-4ef7-bd45-4a2688815e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:29 devstack sudo[113967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD Aug 27 03:57:29 devstack sudo[113967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13a82fe4-4c3e-4ef7-bd45-4a2688815e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1917817903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe2aeb98-2253-41c4-9a6e-b5cb83f89efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c750d918188048b5b214288265cd12e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:30Z,use_quota=True,user_id='26979494902b4919b4e50a88045cc58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (449c6de9-19fd-468d-a5b8-63ae2907b287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (449c6de9-19fd-468d-a5b8-63ae2907b287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01716be-0a6d-4c01-9b2a-204edaaaab15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01716be-0a6d-4c01-9b2a-204edaaaab15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe2aeb98-2253-41c4-9a6e-b5cb83f89efe', 'volume_name': 'volume-fe2aeb98-2253-41c4-9a6e-b5cb83f89efe', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f574b522-ada4-42aa-867b-251d3bc386ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:29 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f574b522-ada4-42aa-867b-251d3bc386ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae5a163e-e9c1-49fd-a4f7-c2655610b3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:30 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Volume fe2aeb98-2253-41c4-9a6e-b5cb83f89efe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe2aeb98-2253-41c4-9a6e-b5cb83f89efe', 'volume_size': 1} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:30 devstack sudo[113963]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:30 devstack sudo[113967]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b51292e2-0851-4e68-93d0-234d38545514 tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf" returned: 0 in 0.545s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b51292e2-0851-4e68-93d0-234d38545514 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.e9b1bbf5-0f92-41f1-8ca5-64d58012f825 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD" returned: 1 in 0.397s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD' failed. Not Retrying. {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Temporary image fa3887d4-53be-4575-b288-8269d93376cd is fetched for user 76ce48f5bb7742eb95eb1e4865fcb5a8. {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 27 03:57:30 devstack sudo[113975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.e9b1bbf5-0f92-41f1-8ca5-64d58012f825 1G Aug 27 03:57:30 devstack sudo[113975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04865cb-f7d6-4b74-930c-5b94eecbeb6b]: (4, 'raw') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Flow 'volume_create_manager' (49d0867c-258b-41d2-9190-45a5df8b72f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf89f8d-c3a7-48ca-bdd3-a2e15d4da6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf89f8d-c3a7-48ca-bdd3-a2e15d4da6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-555815881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db036b1-ed35-4fec-addb-36a94f601410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b516f5f50894efe9e0dae164db282f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:30Z,use_quota=True,user_id='047b328947724678b8346e34d555b8a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df36f39-193a-4d07-8f72-f0348a1a9f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df36f39-193a-4d07-8f72-f0348a1a9f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf91ce8e-f9b4-4194-b81b-e655d25476fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf91ce8e-f9b4-4194-b81b-e655d25476fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9db036b1-ed35-4fec-addb-36a94f601410', 'volume_name': 'volume-9db036b1-ed35-4fec-addb-36a94f601410', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99cd3db3-f786-4406-895d-98bfb67d9b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99cd3db3-f786-4406-895d-98bfb67d9b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e6f1da-daf3-4e25-b6cd-24a9856b59dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:30 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Volume 9db036b1-ed35-4fec-addb-36a94f601410: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9db036b1-ed35-4fec-addb-36a94f601410', 'volume_size': 1} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:30 devstack sudo[113977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD Aug 27 03:57:30 devstack sudo[113977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:30 devstack sudo[113975]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Flow 'volume_create_manager' (b4fa9155-fa89-446c-bd0f-7dfd9bb9bc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:30 devstack sudo[113977]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49a9fbd-293d-44ad-b64c-9ac02f3060fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b51292e2-0851-4e68-93d0-234d38545514 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.e9b1bbf5-0f92-41f1-8ca5-64d58012f825 1G" returned: 0 in 0.554s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b51292e2-0851-4e68-93d0-234d38545514 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ef5a89-4433-4beb-852f-5961daeb44bf -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.e9b1bbf5-0f92-41f1-8ca5-64d58012f825 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD" returned: 0 in 0.453s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:30 devstack sudo[113986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ef5a89-4433-4beb-852f-5961daeb44bf -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.e9b1bbf5-0f92-41f1-8ca5-64d58012f825 Aug 27 03:57:30 devstack sudo[113986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49a9fbd-293d-44ad-b64c-9ac02f3060fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1479051386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b516f5f50894efe9e0dae164db282f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:31Z,use_quota=True,user_id='047b328947724678b8346e34d555b8a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39fd05ea-7cf4-49d4-9f78-1c5b2155a490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39fd05ea-7cf4-49d4-9f78-1c5b2155a490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb8c4c8-8f02-4c81-b867-a327d62d17c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb8c4c8-8f02-4c81-b867-a327d62d17c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2', 'volume_name': 'volume-e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f224c3da-c635-4f6a-bc9f-d2f7666a55bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f224c3da-c635-4f6a-bc9f-d2f7666a55bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274c3d73-b1b3-4f6a-bae0-e116f4d74fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:30 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Volume e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2', 'volume_size': 1} Aug 27 03:57:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:30 devstack sudo[113987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD Aug 27 03:57:30 devstack sudo[113987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:31 devstack sudo[113986]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b51292e2-0851-4e68-93d0-234d38545514 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ef5a89-4433-4beb-852f-5961daeb44bf -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.e9b1bbf5-0f92-41f1-8ca5-64d58012f825" returned: 0 in 0.381s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:31 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-b51292e2-0851-4e68-93d0-234d38545514 tempest-ProjectMemberTests-1426758417 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.e9b1bbf5-0f92-41f1-8ca5-64d58012f825 is being set with open permissions: ugo+rw Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b51292e2-0851-4e68-93d0-234d38545514 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.e9b1bbf5-0f92-41f1-8ca5-64d58012f825 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:31 devstack sudo[113994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.e9b1bbf5-0f92-41f1-8ca5-64d58012f825 Aug 27 03:57:31 devstack sudo[113994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Flow 'volume_create_manager' (0de99e56-d213-402e-bfd4-e060f7cd7957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:31 devstack sudo[113987]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23072eb-f904-4002-ba09-c9f802a23ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD" returned: 1 in 0.442s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD' failed. Not Retrying. {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23072eb-f904-4002-ba09-c9f802a23ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-357807308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5474cf-021b-4ca8-9984-7234ea85d134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b516f5f50894efe9e0dae164db282f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:31Z,use_quota=True,user_id='047b328947724678b8346e34d555b8a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf4b94be-6ec9-4074-8888-289e640aaf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf4b94be-6ec9-4074-8888-289e640aaf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378d73f6-9325-45d7-823f-c773e2d8535d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378d73f6-9325-45d7-823f-c773e2d8535d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da5474cf-021b-4ca8-9984-7234ea85d134', 'volume_name': 'volume-da5474cf-021b-4ca8-9984-7234ea85d134', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aa01027-8f07-44c0-b2f7-e6ea8033f7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aa01027-8f07-44c0-b2f7-e6ea8033f7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e78c09db-17fb-49bb-851f-2c5d5cd3bfb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:31 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Volume da5474cf-021b-4ca8-9984-7234ea85d134: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da5474cf-021b-4ca8-9984-7234ea85d134', 'volume_size': 1} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:31 devstack sudo[113994]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b51292e2-0851-4e68-93d0-234d38545514 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.e9b1bbf5-0f92-41f1-8ca5-64d58012f825" returned: 0 in 0.293s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b51292e2-0851-4e68-93d0-234d38545514 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:31 devstack sudo[114000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.info Aug 27 03:57:31 devstack sudo[114000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Flow 'volume_create_manager' (b0868957-3588-44f4-adbe-a0d06ab52164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e72c6e2c-ce54-49d4-8fb2-f35aab6fd0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e72c6e2c-ce54-49d4-8fb2-f35aab6fd0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-220187813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=606f9119-3965-4256-8c72-b55994e7b4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b516f5f50894efe9e0dae164db282f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:32Z,use_quota=True,user_id='047b328947724678b8346e34d555b8a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a05447-4156-4cfe-a74f-ce952765e15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a05447-4156-4cfe-a74f-ce952765e15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e014f9-41a0-4556-8375-34f274326d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e014f9-41a0-4556-8375-34f274326d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '606f9119-3965-4256-8c72-b55994e7b4c9', 'volume_name': 'volume-606f9119-3965-4256-8c72-b55994e7b4c9', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c08f7c3-97d3-4dba-ad7b-4066d3c367c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c08f7c3-97d3-4dba-ad7b-4066d3c367c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fda0f61-1d47-4ae8-9094-dbcc9af2a762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:31 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Volume 606f9119-3965-4256-8c72-b55994e7b4c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-606f9119-3965-4256-8c72-b55994e7b4c9', 'volume_size': 1} Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:31 devstack sudo[114000]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b51292e2-0851-4e68-93d0-234d38545514 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.info" returned: 0 in 0.269s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:31 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-b51292e2-0851-4e68-93d0-234d38545514 tempest-ProjectMemberTests-1426758417 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.info is being set with open permissions: ugo+rw Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b51292e2-0851-4e68-93d0-234d38545514 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:31 devstack sudo[114003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.info Aug 27 03:57:31 devstack sudo[114003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:31 devstack sudo[114003]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b51292e2-0851-4e68-93d0-234d38545514 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.info" returned: 0 in 0.259s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b51292e2-0851-4e68-93d0-234d38545514 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.415s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.323s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-652423726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9eee4b-0410-4c9a-955f-5cae73925bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c750d918188048b5b214288265cd12e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:28Z,use_quota=True,user_id='26979494902b4919b4e50a88045cc58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Creating volume df9eee4b-0410-4c9a-955f-5cae73925bac {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:32 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-df9eee4b-0410-4c9a-955f-5cae73925bac 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:32 devstack sudo[114006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-df9eee4b-0410-4c9a-955f-5cae73925bac 1073741824 Aug 27 03:57:32 devstack sudo[114006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Flow 'volume_create_manager' (28e6f9fa-6edc-4035-92ff-3c209ba27d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cdc26b5-128b-4905-aaa3-e70440f6bcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:32 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-b51292e2-0851-4e68-93d0-234d38545514 tempest-ProjectMemberTests-1426758417 None] Create snapshot completed successfully Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cdc26b5-128b-4905-aaa3-e70440f6bcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-168016257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c97d15f-2bec-4963-9de5-6d1a38d3bb55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b516f5f50894efe9e0dae164db282f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:32Z,use_quota=True,user_id='047b328947724678b8346e34d555b8a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8988ec2b-b2a0-4965-8a77-90766925574c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8988ec2b-b2a0-4965-8a77-90766925574c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6547d4a-7aba-43e7-9b8d-268fd57bb9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6547d4a-7aba-43e7-9b8d-268fd57bb9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c97d15f-2bec-4963-9de5-6d1a38d3bb55', 'volume_name': 'volume-9c97d15f-2bec-4963-9de5-6d1a38d3bb55', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db311861-a16f-4e1c-849c-a28dceb8e22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db311861-a16f-4e1c-849c-a28dceb8e22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aada02f-3c3a-4e5d-96e3-9341f23599df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:32 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Volume 9c97d15f-2bec-4963-9de5-6d1a38d3bb55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c97d15f-2bec-4963-9de5-6d1a38d3bb55', 'volume_size': 1} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:32 devstack sudo[114006]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-df9eee4b-0410-4c9a-955f-5cae73925bac 1073741824" returned: 0 in 0.471s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-df9eee4b-0410-4c9a-955f-5cae73925bac {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:32 devstack sudo[114011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-df9eee4b-0410-4c9a-955f-5cae73925bac Aug 27 03:57:32 devstack sudo[114011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:32 devstack sudo[114011]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-df9eee4b-0410-4c9a-955f-5cae73925bac" returned: 0 in 0.240s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.950s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1060682629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=291f6dbd-2940-4c07-9569-ab172fd3296b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c750d918188048b5b214288265cd12e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:29Z,use_quota=True,user_id='26979494902b4919b4e50a88045cc58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Creating volume 291f6dbd-2940-4c07-9569-ab172fd3296b {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:32 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-291f6dbd-2940-4c07-9569-ab172fd3296b 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf99166-5065-416f-bc14-d0b53ec6fe9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df9eee4b-0410-4c9a-955f-5cae73925bac', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bed3d5f-2b99-4f35-b0d4-f0b32420fbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:32 devstack sudo[114014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-291f6dbd-2940-4c07-9569-ab172fd3296b 1073741824 Aug 27 03:57:32 devstack sudo[114014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:32 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Volume volume-df9eee4b-0410-4c9a-955f-5cae73925bac (df9eee4b-0410-4c9a-955f-5cae73925bac): created successfully Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bed3d5f-2b99-4f35-b0d4-f0b32420fbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Flow 'volume_create_manager' (7693f505-2d8e-4728-94c0-5693fc109f2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:32 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-1eb9c0d1-5d95-47c6-9717-91d11085c311 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Created volume successfully. Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7496e2b2-7647-44d7-b8a2-ef6ef30e1f48 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-e9b1bbf5-0f92-41f1-8ca5-64d58012f825-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7496e2b2-7647-44d7-b8a2-ef6ef30e1f48 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-e9b1bbf5-0f92-41f1-8ca5-64d58012f825-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7496e2b2-7647-44d7-b8a2-ef6ef30e1f48 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-62ef5a89-4433-4beb-852f-5961daeb44bf" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7496e2b2-7647-44d7-b8a2-ef6ef30e1f48 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-62ef5a89-4433-4beb-852f-5961daeb44bf" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7496e2b2-7647-44d7-b8a2-ef6ef30e1f48 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-e9b1bbf5-0f92-41f1-8ca5-64d58012f825" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7496e2b2-7647-44d7-b8a2-ef6ef30e1f48 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-e9b1bbf5-0f92-41f1-8ca5-64d58012f825" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-7496e2b2-7647-44d7-b8a2-ef6ef30e1f48 tempest-ProjectMemberTests-1426758417 None] Deleting offline snapshot e9b1bbf5-0f92-41f1-8ca5-64d58012f825 of volume 62ef5a89-4433-4beb-852f-5961daeb44bf {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-7496e2b2-7647-44d7-b8a2-ef6ef30e1f48 tempest-ProjectMemberTests-1426758417 None] snapshot_file for this snap is: volume-62ef5a89-4433-4beb-852f-5961daeb44bf.e9b1bbf5-0f92-41f1-8ca5-64d58012f825 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4e979f-f65e-443e-93c4-260671f83c46]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7496e2b2-7647-44d7-b8a2-ef6ef30e1f48 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.e9b1bbf5-0f92-41f1-8ca5-64d58012f825 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:33 devstack sudo[114019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.e9b1bbf5-0f92-41f1-8ca5-64d58012f825 Aug 27 03:57:33 devstack sudo[114019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:33 devstack sudo[114014]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-291f6dbd-2940-4c07-9569-ab172fd3296b 1073741824" returned: 0 in 0.465s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-291f6dbd-2940-4c07-9569-ab172fd3296b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:33 devstack sudo[114022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-291f6dbd-2940-4c07-9569-ab172fd3296b Aug 27 03:57:33 devstack sudo[114022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:33 devstack sudo[114019]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7496e2b2-7647-44d7-b8a2-ef6ef30e1f48 tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.e9b1bbf5-0f92-41f1-8ca5-64d58012f825" returned: 0 in 0.375s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-7496e2b2-7647-44d7-b8a2-ef6ef30e1f48 tempest-ProjectMemberTests-1426758417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62ef5a89-4433-4beb-852f-5961daeb44bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3d9751-a73d-4145-b042-51cbe409b25f]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7496e2b2-7647-44d7-b8a2-ef6ef30e1f48 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:33 devstack sudo[114022]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-291f6dbd-2940-4c07-9569-ab172fd3296b" returned: 0 in 0.271s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.393s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1337965009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c750d918188048b5b214288265cd12e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:29Z,use_quota=True,user_id='26979494902b4919b4e50a88045cc58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Creating volume 8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:33 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:33 devstack sudo[114028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf Aug 27 03:57:33 devstack sudo[114028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:33 devstack sudo[114030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac 1073741824 Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d61c3fa2-28ae-4aef-9d8b-38d44660e606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-291f6dbd-2940-4c07-9569-ab172fd3296b', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:33 devstack sudo[114030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd92d37-7142-4ae2-9841-5b18d10c7114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:33 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Volume volume-291f6dbd-2940-4c07-9569-ab172fd3296b (291f6dbd-2940-4c07-9569-ab172fd3296b): created successfully Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd92d37-7142-4ae2-9841-5b18d10c7114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Flow 'volume_create_manager' (8ff7b18d-d958-4eae-a63d-d2b015a1d00b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:33 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-87d2e5e8-85d6-4100-a7b3-b5fbb65068c9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Created volume successfully. Aug 27 03:57:33 devstack sudo[114028]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7496e2b2-7647-44d7-b8a2-ef6ef30e1f48 tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf" returned: 0 in 0.376s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7496e2b2-7647-44d7-b8a2-ef6ef30e1f48 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.e9b1bbf5-0f92-41f1-8ca5-64d58012f825 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:33 devstack sudo[114039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.e9b1bbf5-0f92-41f1-8ca5-64d58012f825 Aug 27 03:57:33 devstack sudo[114039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:34 devstack sudo[114030]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac 1073741824" returned: 0 in 0.449s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:34 devstack sudo[114041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac Aug 27 03:57:34 devstack sudo[114041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:34 devstack sudo[114039]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7496e2b2-7647-44d7-b8a2-ef6ef30e1f48 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.e9b1bbf5-0f92-41f1-8ca5-64d58012f825" returned: 0 in 0.415s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7496e2b2-7647-44d7-b8a2-ef6ef30e1f48 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.e9b1bbf5-0f92-41f1-8ca5-64d58012f825 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:34 devstack sudo[114046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.e9b1bbf5-0f92-41f1-8ca5-64d58012f825 Aug 27 03:57:34 devstack sudo[114046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:34 devstack sudo[114041]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac" returned: 0 in 0.263s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.757s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1819804735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51c9aeb4-8271-4e3e-ab9e-7fe71b763860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c750d918188048b5b214288265cd12e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:29Z,use_quota=True,user_id='26979494902b4919b4e50a88045cc58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Creating volume 51c9aeb4-8271-4e3e-ab9e-7fe71b763860 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:34 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-51c9aeb4-8271-4e3e-ab9e-7fe71b763860 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785c5e21-4c65-404b-a1d0-13b875bbdcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:34 devstack sudo[114049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-51c9aeb4-8271-4e3e-ab9e-7fe71b763860 1073741824 Aug 27 03:57:34 devstack sudo[114049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ddfac1f-f7bf-480b-a495-3a8c1bd6fe84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:34 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Volume volume-8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac (8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac): created successfully Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ddfac1f-f7bf-480b-a495-3a8c1bd6fe84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Flow 'volume_create_manager' (345441eb-7bbe-47be-9eec-92418c57ce5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:34 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-0e8235e1-c20e-4cc2-8ebb-a62eb7c223a7 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Created volume successfully. Aug 27 03:57:34 devstack sudo[114046]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7496e2b2-7647-44d7-b8a2-ef6ef30e1f48 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf.e9b1bbf5-0f92-41f1-8ca5-64d58012f825" returned: 0 in 0.286s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7496e2b2-7647-44d7-b8a2-ef6ef30e1f48 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-e9b1bbf5-0f92-41f1-8ca5-64d58012f825" released by "_delete_snapshot" :: held 1.561s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7496e2b2-7647-44d7-b8a2-ef6ef30e1f48 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-62ef5a89-4433-4beb-852f-5961daeb44bf" released by "delete_snapshot" :: held 1.614s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-7496e2b2-7647-44d7-b8a2-ef6ef30e1f48 tempest-ProjectMemberTests-1426758417 None] Created reservations ['cf615337-43bb-4323-a088-774cfcea5765', 'b95bbba4-4995-4269-965d-59b6c872bc1c', '29914929-6c46-43d6-9f29-78b294a80f14', '8b35d4cc-90e7-44de-899e-23ca55a3bd45'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:34 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-7496e2b2-7647-44d7-b8a2-ef6ef30e1f48 tempest-ProjectMemberTests-1426758417 None] Delete snapshot completed successfully. Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7496e2b2-7647-44d7-b8a2-ef6ef30e1f48 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-e9b1bbf5-0f92-41f1-8ca5-64d58012f825-delete_snapshot" released by "delete_snapshot" :: held 1.790s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:34 devstack sudo[114049]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-51c9aeb4-8271-4e3e-ab9e-7fe71b763860 1073741824" returned: 0 in 0.484s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-51c9aeb4-8271-4e3e-ab9e-7fe71b763860 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:34 devstack sudo[114056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-51c9aeb4-8271-4e3e-ab9e-7fe71b763860 Aug 27 03:57:34 devstack sudo[114056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:35 devstack sudo[114056]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-51c9aeb4-8271-4e3e-ab9e-7fe71b763860" returned: 0 in 0.263s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.104s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1917817903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe2aeb98-2253-41c4-9a6e-b5cb83f89efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c750d918188048b5b214288265cd12e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:30Z,use_quota=True,user_id='26979494902b4919b4e50a88045cc58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Creating volume fe2aeb98-2253-41c4-9a6e-b5cb83f89efe {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:35 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fe2aeb98-2253-41c4-9a6e-b5cb83f89efe 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8623c58f-dab5-43c9-9183-9bc533e76b20 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-62ef5a89-4433-4beb-852f-5961daeb44bf-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02660d5-0507-4abe-9451-f6ce005a5731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51c9aeb4-8271-4e3e-ab9e-7fe71b763860', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:35 devstack sudo[114059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fe2aeb98-2253-41c4-9a6e-b5cb83f89efe 1073741824 Aug 27 03:57:35 devstack sudo[114059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea41a83-426e-4d34-a787-16e0989a4dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8623c58f-dab5-43c9-9183-9bc533e76b20 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-62ef5a89-4433-4beb-852f-5961daeb44bf-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:35 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Volume volume-51c9aeb4-8271-4e3e-ab9e-7fe71b763860 (51c9aeb4-8271-4e3e-ab9e-7fe71b763860): created successfully Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea41a83-426e-4d34-a787-16e0989a4dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Flow 'volume_create_manager' (f47db984-8769-40d7-95f1-a2d08150e5df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:35 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-859a2609-6dfe-46b0-8993-263b4bcb86d9 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Created volume successfully. Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8623c58f-dab5-43c9-9183-9bc533e76b20 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-62ef5a89-4433-4beb-852f-5961daeb44bf" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8623c58f-dab5-43c9-9183-9bc533e76b20 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-62ef5a89-4433-4beb-852f-5961daeb44bf" acquired by "delete_volume" :: waited 0.015s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9bee1f-252b-4788-8469-d43dcf209345]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8623c58f-dab5-43c9-9183-9bc533e76b20 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:35 devstack sudo[114061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf Aug 27 03:57:35 devstack sudo[114061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:35 devstack sudo[114059]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fe2aeb98-2253-41c4-9a6e-b5cb83f89efe 1073741824" returned: 0 in 0.491s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fe2aeb98-2253-41c4-9a6e-b5cb83f89efe {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:35 devstack sudo[114068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fe2aeb98-2253-41c4-9a6e-b5cb83f89efe Aug 27 03:57:35 devstack sudo[114068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:35 devstack sudo[114061]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8623c58f-dab5-43c9-9183-9bc533e76b20 tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf" returned: 0 in 0.416s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8623c58f-dab5-43c9-9183-9bc533e76b20 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:35 devstack sudo[114071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf Aug 27 03:57:35 devstack sudo[114071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:35 devstack sudo[114068]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fe2aeb98-2253-41c4-9a6e-b5cb83f89efe" returned: 0 in 0.260s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.509s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-555815881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db036b1-ed35-4fec-addb-36a94f601410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b516f5f50894efe9e0dae164db282f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:30Z,use_quota=True,user_id='047b328947724678b8346e34d555b8a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Creating volume 9db036b1-ed35-4fec-addb-36a94f601410 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:35 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9db036b1-ed35-4fec-addb-36a94f601410 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae5a163e-e9c1-49fd-a4f7-c2655610b3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe2aeb98-2253-41c4-9a6e-b5cb83f89efe', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (210b5f12-bb84-4063-8a54-3a8dfbc72a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:35 devstack sudo[114075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9db036b1-ed35-4fec-addb-36a94f601410 1073741824 Aug 27 03:57:35 devstack sudo[114075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:35 devstack sudo[114071]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8623c58f-dab5-43c9-9183-9bc533e76b20 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-62ef5a89-4433-4beb-852f-5961daeb44bf" returned: 0 in 0.246s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:35 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Volume volume-fe2aeb98-2253-41c4-9a6e-b5cb83f89efe (fe2aeb98-2253-41c4-9a6e-b5cb83f89efe): created successfully Aug 27 03:57:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (210b5f12-bb84-4063-8a54-3a8dfbc72a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Flow 'volume_create_manager' (62813743-9c7b-46e1-9210-7530b6016987) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8623c58f-dab5-43c9-9183-9bc533e76b20 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-62ef5a89-4433-4beb-852f-5961daeb44bf" released by "delete_volume" :: held 0.748s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:36 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-0c6c980e-94b4-4fa3-ab41-acffa8d61398 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Created volume successfully. Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-8623c58f-dab5-43c9-9183-9bc533e76b20 tempest-ProjectMemberTests-1426758417 None] Created reservations ['9216e404-6c0e-4c17-a5d6-6e6219e5caf0', 'ecf58ed6-952d-473e-9b3d-46bdaf7fc87d', '4957c205-0989-42a8-b738-621f44838914', '3af2004f-c2cf-4860-80b5-f937f44ad757'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8623c58f-dab5-43c9-9183-9bc533e76b20 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8623c58f-dab5-43c9-9183-9bc533e76b20 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8623c58f-dab5-43c9-9183-9bc533e76b20 tempest-ProjectMemberTests-1426758417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-8623c58f-dab5-43c9-9183-9bc533e76b20 tempest-ProjectMemberTests-1426758417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8623c58f-dab5-43c9-9183-9bc533e76b20 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8623c58f-dab5-43c9-9183-9bc533e76b20 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:36 devstack sudo[114078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:57:36 devstack sudo[114078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:36 devstack sudo[114075]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9db036b1-ed35-4fec-addb-36a94f601410 1073741824" returned: 0 in 0.474s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:36 devstack sudo[114078]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8623c58f-dab5-43c9-9183-9bc533e76b20 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.290s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-8623c58f-dab5-43c9-9183-9bc533e76b20 tempest-ProjectMemberTests-1426758417 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:57:36 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-8623c58f-dab5-43c9-9183-9bc533e76b20 tempest-ProjectMemberTests-1426758417 None] Deleted volume successfully. Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9db036b1-ed35-4fec-addb-36a94f601410 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8623c58f-dab5-43c9-9183-9bc533e76b20 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-62ef5a89-4433-4beb-852f-5961daeb44bf-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:36 devstack sudo[114084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9db036b1-ed35-4fec-addb-36a94f601410 Aug 27 03:57:36 devstack sudo[114084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9d8e25dc-f988-4a25-bec4-f25055d52e07 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "cinder-fe2aeb98-2253-41c4-9a6e-b5cb83f89efe-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9d8e25dc-f988-4a25-bec4-f25055d52e07 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "cinder-fe2aeb98-2253-41c4-9a6e-b5cb83f89efe-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9d8e25dc-f988-4a25-bec4-f25055d52e07 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "cinder-quobyte-fe2aeb98-2253-41c4-9a6e-b5cb83f89efe" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9d8e25dc-f988-4a25-bec4-f25055d52e07 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "cinder-quobyte-fe2aeb98-2253-41c4-9a6e-b5cb83f89efe" acquired by "delete_volume" :: waited 0.026s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36213b7-ac71-4b0f-965e-b1480ebdaa9c]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9d8e25dc-f988-4a25-bec4-f25055d52e07 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fe2aeb98-2253-41c4-9a6e-b5cb83f89efe {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:36 devstack sudo[114084]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Flow 'volume_create_manager' (1a554cc6-a9ef-4190-94a5-845c6df5440e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b40939f-3053-40fe-b1e1-13c1da05d342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9db036b1-ed35-4fec-addb-36a94f601410" returned: 0 in 0.389s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:36 devstack sudo[114086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fe2aeb98-2253-41c4-9a6e-b5cb83f89efe Aug 27 03:57:36 devstack sudo[114086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.024s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1479051386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b516f5f50894efe9e0dae164db282f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:31Z,use_quota=True,user_id='047b328947724678b8346e34d555b8a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Creating volume e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:36 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b40939f-3053-40fe-b1e1-13c1da05d342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-274847374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c8dc11-9bff-4924-9ac8-40eadef278b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8658e7bcb5964a65a4672729d843a24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:37Z,use_quota=True,user_id='d1b1c78558e94e16b33cfaf2594e5ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:36 devstack sudo[114089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2 1073741824 Aug 27 03:57:36 devstack sudo[114089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255b7fe3-b91c-4481-b79b-d3ed46d5aa2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255b7fe3-b91c-4481-b79b-d3ed46d5aa2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0dd90d-a8e1-4729-9972-54079425f714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0dd90d-a8e1-4729-9972-54079425f714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9c8dc11-9bff-4924-9ac8-40eadef278b3', 'volume_name': 'volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05143301-e82e-4e23-ad5f-4671e8a9e5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05143301-e82e-4e23-ad5f-4671e8a9e5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d666c7c6-d8df-4dea-8df2-a5247c84f8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:36 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Volume b9c8dc11-9bff-4924-9ac8-40eadef278b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3', 'volume_size': 1} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e6f1da-daf3-4e25-b6cd-24a9856b59dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9db036b1-ed35-4fec-addb-36a94f601410', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbebf7d8-2fe2-4f29-87a5-3e3df3e31fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:36 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Volume volume-9db036b1-ed35-4fec-addb-36a94f601410 (9db036b1-ed35-4fec-addb-36a94f601410): created successfully Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbebf7d8-2fe2-4f29-87a5-3e3df3e31fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Flow 'volume_create_manager' (49d0867c-258b-41d2-9190-45a5df8b72f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:36 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d5b67eef-2b96-4c86-b22e-4d673df20bb1 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Created volume successfully. Aug 27 03:57:37 devstack sudo[114086]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9d8e25dc-f988-4a25-bec4-f25055d52e07 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fe2aeb98-2253-41c4-9a6e-b5cb83f89efe" returned: 0 in 0.410s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9d8e25dc-f988-4a25-bec4-f25055d52e07 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fe2aeb98-2253-41c4-9a6e-b5cb83f89efe {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:37 devstack sudo[114098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fe2aeb98-2253-41c4-9a6e-b5cb83f89efe Aug 27 03:57:37 devstack sudo[114098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:37 devstack sudo[114089]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2 1073741824" returned: 0 in 0.466s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:37 devstack sudo[114101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2 Aug 27 03:57:37 devstack sudo[114101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:37 devstack sudo[114098]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9d8e25dc-f988-4a25-bec4-f25055d52e07 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fe2aeb98-2253-41c4-9a6e-b5cb83f89efe" returned: 0 in 0.281s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9d8e25dc-f988-4a25-bec4-f25055d52e07 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "cinder-quobyte-fe2aeb98-2253-41c4-9a6e-b5cb83f89efe" released by "delete_volume" :: held 0.760s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-9d8e25dc-f988-4a25-bec4-f25055d52e07 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Created reservations ['522974ff-8974-47fe-8da6-0187193cc47a', '1c591313-d0a0-476b-b30b-c76748836ed3', 'ca2b85f0-97a7-4a9d-bfac-748e82fbece7', '672b7e17-cd03-4e46-8f7e-4e25f4d4f501'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9d8e25dc-f988-4a25-bec4-f25055d52e07 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9d8e25dc-f988-4a25-bec4-f25055d52e07 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-9d8e25dc-f988-4a25-bec4-f25055d52e07 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-9d8e25dc-f988-4a25-bec4-f25055d52e07 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9d8e25dc-f988-4a25-bec4-f25055d52e07 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9d8e25dc-f988-4a25-bec4-f25055d52e07 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:37 devstack sudo[114103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:57:37 devstack sudo[114103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:37 devstack sudo[114101]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2" returned: 0 in 0.255s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.434s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b79e6294-ff52-4af8-a011-7dd4630a5b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4de75533c594456b731830a01a33a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:28Z,use_quota=True,user_id='76ce48f5bb7742eb95eb1e4865fcb5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b8625a1-6f26-4732-ba44-e033c2e51f7f),volume_type_id=8b8625a1-6f26-4732-ba44-e033c2e51f7f)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Creating volume b79e6294-ff52-4af8-a011-7dd4630a5b4c {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:37 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b79e6294-ff52-4af8-a011-7dd4630a5b4c 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:37 devstack sudo[114106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b79e6294-ff52-4af8-a011-7dd4630a5b4c 1073741824 Aug 27 03:57:37 devstack sudo[114106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274c3d73-b1b3-4f6a-bae0-e116f4d74fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ffa81b-a908-4475-a54a-ad67954b1286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:37 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Volume volume-e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2 (e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2): created successfully Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ffa81b-a908-4475-a54a-ad67954b1286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Flow 'volume_create_manager' (b4fa9155-fa89-446c-bd0f-7dfd9bb9bc45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:37 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f5ae45b3-c0a0-4f1d-ba1b-c8cf9d208509 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Created volume successfully. Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a9014be1-e20a-4edc-a73e-136424e8e70b tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "cinder-51c9aeb4-8271-4e3e-ab9e-7fe71b763860-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:37 devstack sudo[114103]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9d8e25dc-f988-4a25-bec4-f25055d52e07 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.281s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-9d8e25dc-f988-4a25-bec4-f25055d52e07 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a9014be1-e20a-4edc-a73e-136424e8e70b tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "cinder-51c9aeb4-8271-4e3e-ab9e-7fe71b763860-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:37 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-9d8e25dc-f988-4a25-bec4-f25055d52e07 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Deleted volume successfully. Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9d8e25dc-f988-4a25-bec4-f25055d52e07 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "cinder-fe2aeb98-2253-41c4-9a6e-b5cb83f89efe-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a9014be1-e20a-4edc-a73e-136424e8e70b tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "cinder-quobyte-51c9aeb4-8271-4e3e-ab9e-7fe71b763860" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a9014be1-e20a-4edc-a73e-136424e8e70b tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "cinder-quobyte-51c9aeb4-8271-4e3e-ab9e-7fe71b763860" acquired by "delete_volume" :: waited 0.015s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc7d123-1773-41f4-9b0e-636d327666e2]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a9014be1-e20a-4edc-a73e-136424e8e70b tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-51c9aeb4-8271-4e3e-ab9e-7fe71b763860 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:38 devstack sudo[114110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-51c9aeb4-8271-4e3e-ab9e-7fe71b763860 Aug 27 03:57:38 devstack sudo[114110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:38 devstack sudo[114106]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b79e6294-ff52-4af8-a011-7dd4630a5b4c 1073741824" returned: 0 in 0.493s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b79e6294-ff52-4af8-a011-7dd4630a5b4c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:38 devstack sudo[114116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b79e6294-ff52-4af8-a011-7dd4630a5b4c Aug 27 03:57:38 devstack sudo[114116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:38 devstack sudo[114110]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a9014be1-e20a-4edc-a73e-136424e8e70b tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-51c9aeb4-8271-4e3e-ab9e-7fe71b763860" returned: 0 in 0.426s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a9014be1-e20a-4edc-a73e-136424e8e70b tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-51c9aeb4-8271-4e3e-ab9e-7fe71b763860 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:38 devstack sudo[114121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-51c9aeb4-8271-4e3e-ab9e-7fe71b763860 Aug 27 03:57:38 devstack sudo[114121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:38 devstack sudo[114116]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b79e6294-ff52-4af8-a011-7dd4630a5b4c" returned: 0 in 0.268s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.172s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-357807308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5474cf-021b-4ca8-9984-7234ea85d134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b516f5f50894efe9e0dae164db282f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:31Z,use_quota=True,user_id='047b328947724678b8346e34d555b8a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Creating volume da5474cf-021b-4ca8-9984-7234ea85d134 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:38 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-da5474cf-021b-4ca8-9984-7234ea85d134 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:38 devstack sudo[114124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-da5474cf-021b-4ca8-9984-7234ea85d134 1073741824 Aug 27 03:57:38 devstack sudo[114124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Attempting download of fa3887d4-53be-4575-b288-8269d93376cd ((None, [{'url': 'file:///opt/stack/data/glance/images/fa3887d4-53be-4575-b288-8269d93376cd', 'metadata': {}}])) to volume b79e6294-ff52-4af8-a011-7dd4630a5b4c. {{(pid=94328) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2a9eac-6e1b-4158-9b04-8c7b46b7a816]: (4, 'raw') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa3887d4-53be-4575-b288-8269d93376cd_rxajv654 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:38 devstack sudo[114121]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a9014be1-e20a-4edc-a73e-136424e8e70b tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-51c9aeb4-8271-4e3e-ab9e-7fe71b763860" returned: 0 in 0.261s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a9014be1-e20a-4edc-a73e-136424e8e70b tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "cinder-quobyte-51c9aeb4-8271-4e3e-ab9e-7fe71b763860" released by "delete_volume" :: held 0.726s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:38 devstack sudo[114126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa3887d4-53be-4575-b288-8269d93376cd_rxajv654 Aug 27 03:57:38 devstack sudo[114126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-a9014be1-e20a-4edc-a73e-136424e8e70b tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Created reservations ['945bcddb-60e7-4467-832a-7e83ae022bca', '48b68220-5745-45d5-8a46-94966f30ebd1', 'f5841452-b291-4f07-bdf6-ab1666d52b5b', 'e78d0b24-5324-4b74-8bff-ad9b3eb33b1a'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a9014be1-e20a-4edc-a73e-136424e8e70b tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a9014be1-e20a-4edc-a73e-136424e8e70b tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a9014be1-e20a-4edc-a73e-136424e8e70b tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-a9014be1-e20a-4edc-a73e-136424e8e70b tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a9014be1-e20a-4edc-a73e-136424e8e70b tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a9014be1-e20a-4edc-a73e-136424e8e70b tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:38 devstack sudo[114132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:57:38 devstack sudo[114132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:38 devstack sudo[114126]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa3887d4-53be-4575-b288-8269d93376cd_rxajv654" returned: 0 in 0.387s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa3887d4-53be-4575-b288-8269d93376cd_rxajv654 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d98105a0-3009-4854-9002-2f4520aa34ae tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "cinder-8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d98105a0-3009-4854-9002-2f4520aa34ae tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "cinder-8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:39 devstack sudo[114124]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-da5474cf-021b-4ca8-9984-7234ea85d134 1073741824" returned: 0 in 0.600s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d98105a0-3009-4854-9002-2f4520aa34ae tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "cinder-quobyte-8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:39 devstack sudo[114137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa3887d4-53be-4575-b288-8269d93376cd_rxajv654 Aug 27 03:57:39 devstack sudo[114137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d98105a0-3009-4854-9002-2f4520aa34ae tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "cinder-quobyte-8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac" acquired by "delete_volume" :: waited 0.030s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-da5474cf-021b-4ca8-9984-7234ea85d134 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:39 devstack sudo[114132]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13772e0-0c85-46fe-a188-29228457a0a6]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d98105a0-3009-4854-9002-2f4520aa34ae tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:39 devstack sudo[114140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-da5474cf-021b-4ca8-9984-7234ea85d134 Aug 27 03:57:39 devstack sudo[114140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a9014be1-e20a-4edc-a73e-136424e8e70b tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.374s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-a9014be1-e20a-4edc-a73e-136424e8e70b tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:57:39 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-a9014be1-e20a-4edc-a73e-136424e8e70b tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Deleted volume successfully. Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-a9014be1-e20a-4edc-a73e-136424e8e70b tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "cinder-51c9aeb4-8271-4e3e-ab9e-7fe71b763860-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:39 devstack sudo[114141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac Aug 27 03:57:39 devstack sudo[114141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:39 devstack sudo[114137]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa3887d4-53be-4575-b288-8269d93376cd_rxajv654" returned: 1 in 0.445s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa3887d4-53be-4575-b288-8269d93376cd_rxajv654' failed. Not Retrying. {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1f7395-4a31-4751-a8f2-4e99fd4fc470]: (4, 'raw') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:39 devstack sudo[114140]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-da5474cf-021b-4ca8-9984-7234ea85d134" returned: 0 in 0.314s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.791s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-220187813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=606f9119-3965-4256-8c72-b55994e7b4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b516f5f50894efe9e0dae164db282f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:32Z,use_quota=True,user_id='047b328947724678b8346e34d555b8a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Creating volume 606f9119-3965-4256-8c72-b55994e7b4c9 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:39 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-606f9119-3965-4256-8c72-b55994e7b4c9 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e78c09db-17fb-49bb-851f-2c5d5cd3bfb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da5474cf-021b-4ca8-9984-7234ea85d134', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:39 devstack sudo[114148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-606f9119-3965-4256-8c72-b55994e7b4c9 1073741824 Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b25ce7d-9714-4851-a0af-3f5abcfca6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:39 devstack sudo[114148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:39 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Volume volume-da5474cf-021b-4ca8-9984-7234ea85d134 (da5474cf-021b-4ca8-9984-7234ea85d134): created successfully Aug 27 03:57:39 devstack sudo[114147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD Aug 27 03:57:39 devstack sudo[114147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b25ce7d-9714-4851-a0af-3f5abcfca6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Flow 'volume_create_manager' (0de99e56-d213-402e-bfd4-e060f7cd7957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:39 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-45b8e048-a86b-4e53-91d6-253fde6fc57c tempest-CreateVolumesFromSnapshotTest-1966912875 None] Created volume successfully. Aug 27 03:57:39 devstack sudo[114141]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d98105a0-3009-4854-9002-2f4520aa34ae tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac" returned: 0 in 0.434s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d98105a0-3009-4854-9002-2f4520aa34ae tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:39 devstack sudo[114155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac Aug 27 03:57:39 devstack sudo[114155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:39 devstack sudo[114147]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:39 devstack sudo[114155]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d98105a0-3009-4854-9002-2f4520aa34ae tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac" returned: 0 in 0.263s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d98105a0-3009-4854-9002-2f4520aa34ae tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "cinder-quobyte-8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac" released by "delete_volume" :: held 0.741s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:39 devstack sudo[114162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD Aug 27 03:57:39 devstack sudo[114162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:39 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-d98105a0-3009-4854-9002-2f4520aa34ae tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Created reservations ['e63ea53a-108f-497c-b5d7-427bbf7a6e5d', '226f5652-2222-4e60-bfe9-b65c662271a7', 'ab430806-ebb9-4a46-8273-1c4bc3fa7069', 'ed61ee32-e3ce-4e45-bafb-e22b744064c5'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:40 devstack sudo[114148]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-606f9119-3965-4256-8c72-b55994e7b4c9 1073741824" returned: 0 in 0.536s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d98105a0-3009-4854-9002-2f4520aa34ae tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d98105a0-3009-4854-9002-2f4520aa34ae tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d98105a0-3009-4854-9002-2f4520aa34ae tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d98105a0-3009-4854-9002-2f4520aa34ae tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d98105a0-3009-4854-9002-2f4520aa34ae tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d98105a0-3009-4854-9002-2f4520aa34ae tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:40 devstack sudo[114165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:57:40 devstack sudo[114165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-606f9119-3965-4256-8c72-b55994e7b4c9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:40 devstack sudo[114167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-606f9119-3965-4256-8c72-b55994e7b4c9 Aug 27 03:57:40 devstack sudo[114167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:40 devstack sudo[114162]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD" returned: 1 in 0.408s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD' failed. Not Retrying. {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] fa3887d4-53be-4575-b288-8269d93376cd was raw, converting to qcow2 {{(pid=94328) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b79e6294-ff52-4af8-a011-7dd4630a5b4c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4ad28cde-7010-4299-88eb-ceedcbe11256 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "cinder-291f6dbd-2940-4c07-9569-ab172fd3296b-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:40 devstack sudo[114172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b79e6294-ff52-4af8-a011-7dd4630a5b4c Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4ad28cde-7010-4299-88eb-ceedcbe11256 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "cinder-291f6dbd-2940-4c07-9569-ab172fd3296b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:40 devstack sudo[114172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4ad28cde-7010-4299-88eb-ceedcbe11256 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "cinder-quobyte-291f6dbd-2940-4c07-9569-ab172fd3296b" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4ad28cde-7010-4299-88eb-ceedcbe11256 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "cinder-quobyte-291f6dbd-2940-4c07-9569-ab172fd3296b" acquired by "delete_volume" :: waited 0.018s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[adce67ec-d5de-4010-8879-22a8151c871a]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4ad28cde-7010-4299-88eb-ceedcbe11256 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-291f6dbd-2940-4c07-9569-ab172fd3296b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:40 devstack sudo[114165]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d98105a0-3009-4854-9002-2f4520aa34ae tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.340s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-d98105a0-3009-4854-9002-2f4520aa34ae tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:57:40 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d98105a0-3009-4854-9002-2f4520aa34ae tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Deleted volume successfully. Aug 27 03:57:40 devstack sudo[114167]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-606f9119-3965-4256-8c72-b55994e7b4c9" returned: 0 in 0.303s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.248s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-168016257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c97d15f-2bec-4963-9de5-6d1a38d3bb55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b516f5f50894efe9e0dae164db282f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:32Z,use_quota=True,user_id='047b328947724678b8346e34d555b8a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Creating volume 9c97d15f-2bec-4963-9de5-6d1a38d3bb55 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:40 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9c97d15f-2bec-4963-9de5-6d1a38d3bb55 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:40 devstack sudo[114177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9c97d15f-2bec-4963-9de5-6d1a38d3bb55 1073741824 Aug 27 03:57:40 devstack sudo[114177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fda0f61-1d47-4ae8-9094-dbcc9af2a762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-606f9119-3965-4256-8c72-b55994e7b4c9', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2c303d6-be32-4967-911a-a8127f6bdad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d98105a0-3009-4854-9002-2f4520aa34ae tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "cinder-8a3137ca-9fef-43f1-aaff-33f9ab9ca4ac-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:40 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Volume volume-606f9119-3965-4256-8c72-b55994e7b4c9 (606f9119-3965-4256-8c72-b55994e7b4c9): created successfully Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2c303d6-be32-4967-911a-a8127f6bdad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:40 devstack sudo[114176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-291f6dbd-2940-4c07-9569-ab172fd3296b Aug 27 03:57:40 devstack sudo[114176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Flow 'volume_create_manager' (b0868957-3588-44f4-adbe-a0d06ab52164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:40 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-4bb7c7cb-f6ea-4e85-98ea-2964b8d06374 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Created volume successfully. Aug 27 03:57:40 devstack sudo[114176]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4ad28cde-7010-4299-88eb-ceedcbe11256 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-291f6dbd-2940-4c07-9569-ab172fd3296b" returned: 0 in 0.422s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4ad28cde-7010-4299-88eb-ceedcbe11256 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-291f6dbd-2940-4c07-9569-ab172fd3296b {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:40 devstack sudo[114172]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b79e6294-ff52-4af8-a011-7dd4630a5b4c" returned: 0 in 0.602s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fa3887d4-53be-4575-b288-8269d93376cd_19ctj62udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b79e6294-ff52-4af8-a011-7dd4630a5b4c {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:57:40 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Converted 0.00 MB image at 0.00 MB/s Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b79e6294-ff52-4af8-a011-7dd4630a5b4c 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:40 devstack sudo[114190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-291f6dbd-2940-4c07-9569-ab172fd3296b Aug 27 03:57:40 devstack sudo[114190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:40 devstack sudo[114192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b79e6294-ff52-4af8-a011-7dd4630a5b4c 1G Aug 27 03:57:40 devstack sudo[114192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:40 devstack sudo[114177]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9c97d15f-2bec-4963-9de5-6d1a38d3bb55 1073741824" returned: 0 in 0.517s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9c97d15f-2bec-4963-9de5-6d1a38d3bb55 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:40 devstack sudo[114195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9c97d15f-2bec-4963-9de5-6d1a38d3bb55 Aug 27 03:57:40 devstack sudo[114195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:41 devstack sudo[114190]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4ad28cde-7010-4299-88eb-ceedcbe11256 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-291f6dbd-2940-4c07-9569-ab172fd3296b" returned: 0 in 0.293s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4ad28cde-7010-4299-88eb-ceedcbe11256 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "cinder-quobyte-291f6dbd-2940-4c07-9569-ab172fd3296b" released by "delete_volume" :: held 0.763s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-4ad28cde-7010-4299-88eb-ceedcbe11256 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Created reservations ['74387b6c-949e-48c6-b4f5-2246a71b743d', '961aee68-20de-4c48-9e50-0d174b3fda04', 'f706772e-4e9d-4b49-839c-8fce26de1249', 'aada0e95-72b2-4e88-bbcd-87c763670e44'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:41 devstack sudo[114192]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b79e6294-ff52-4af8-a011-7dd4630a5b4c 1G" returned: 0 in 0.362s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Downloaded image fa3887d4-53be-4575-b288-8269d93376cd ((None, [{'url': 'file:///opt/stack/data/glance/images/fa3887d4-53be-4575-b288-8269d93376cd', 'metadata': {}}])) to volume b79e6294-ff52-4af8-a011-7dd4630a5b4c successfully. {{(pid=94328) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Temporary image fa3887d4-53be-4575-b288-8269d93376cd for user 76ce48f5bb7742eb95eb1e4865fcb5a8 is deleted. {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Marking volume b79e6294-ff52-4af8-a011-7dd4630a5b4c as bootable. {{(pid=94328) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Copying metadata from image fa3887d4-53be-4575-b288-8269d93376cd to b79e6294-ff52-4af8-a011-7dd4630a5b4c. {{(pid=94328) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Creating volume glance metadata for volume b79e6294-ff52-4af8-a011-7dd4630a5b4c backed by image fa3887d4-53be-4575-b288-8269d93376cd with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'fa3887d4-53be-4575-b288-8269d93376cd', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c2fcc3f8fcd68a603d0bb63a15cd58ca', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94328) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 27 03:57:41 devstack sudo[114195]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4ad28cde-7010-4299-88eb-ceedcbe11256 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4ad28cde-7010-4299-88eb-ceedcbe11256 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4ad28cde-7010-4299-88eb-ceedcbe11256 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4ad28cde-7010-4299-88eb-ceedcbe11256 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4ad28cde-7010-4299-88eb-ceedcbe11256 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4ad28cde-7010-4299-88eb-ceedcbe11256 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9c97d15f-2bec-4963-9de5-6d1a38d3bb55" returned: 0 in 0.308s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.328s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-274847374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c8dc11-9bff-4924-9ac8-40eadef278b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8658e7bcb5964a65a4672729d843a24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:37Z,use_quota=True,user_id='d1b1c78558e94e16b33cfaf2594e5ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Creating volume b9c8dc11-9bff-4924-9ac8-40eadef278b3 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:41 devstack sudo[114202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:41 devstack sudo[114202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:41 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:41 devstack sudo[114204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3 1073741824 Aug 27 03:57:41 devstack sudo[114204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aada02f-3c3a-4e5d-96e3-9341f23599df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c97d15f-2bec-4963-9de5-6d1a38d3bb55', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd114f62-123d-48ba-89f3-3f392ff87eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a13b1d2-4a72-4f98-85a0-cf753b45f2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b79e6294-ff52-4af8-a011-7dd4630a5b4c', 'volume_size': 1, 'image_id': 'fa3887d4-53be-4575-b288-8269d93376cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa3887d4-53be-4575-b288-8269d93376cd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c2fcc3f8fcd68a603d0bb63a15cd58ca', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e4de75533c594456b731830a01a33a21', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3e8d22c1c7601763c57a3784833bb3918db5071d0077871e5ff9c851f8db2f9770d150884b641737c2bf1ccfd605f3f52166140a67c0f092d95c706a3f633863', 'id': 'fa3887d4-53be-4575-b288-8269d93376cd', 'created_at': datetime.datetime(2026, 8, 27, 1, 57, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 57, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa3887d4-53be-4575-b288-8269d93376cd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d1925c-4138-4172-9b6a-33683ee5bd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:41 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Volume volume-9c97d15f-2bec-4963-9de5-6d1a38d3bb55 (9c97d15f-2bec-4963-9de5-6d1a38d3bb55): created successfully Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd114f62-123d-48ba-89f3-3f392ff87eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Flow 'volume_create_manager' (28e6f9fa-6edc-4035-92ff-3c209ba27d3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:41 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Volume volume-b79e6294-ff52-4af8-a011-7dd4630a5b4c (b79e6294-ff52-4af8-a011-7dd4630a5b4c): created successfully Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d1925c-4138-4172-9b6a-33683ee5bd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Flow 'volume_create_manager' (e1251005-6d74-4643-8216-36661da7babb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1393ff4e-12d1-4978-bb76-204282d53d0e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "cinder-df9eee4b-0410-4c9a-955f-5cae73925bac-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:41 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-33ae19a1-21e0-413d-af2d-664bdfb9c500 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Created volume successfully. Aug 27 03:57:41 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-4b158131-226e-4ae0-8f3d-7c2db921596d tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Created volume successfully. Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1393ff4e-12d1-4978-bb76-204282d53d0e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "cinder-df9eee4b-0410-4c9a-955f-5cae73925bac-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1393ff4e-12d1-4978-bb76-204282d53d0e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "cinder-quobyte-df9eee4b-0410-4c9a-955f-5cae73925bac" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1393ff4e-12d1-4978-bb76-204282d53d0e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "cinder-quobyte-df9eee4b-0410-4c9a-955f-5cae73925bac" acquired by "delete_volume" :: waited 0.016s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51b1d81-bc65-452f-8cdb-492b52d80980]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1393ff4e-12d1-4978-bb76-204282d53d0e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-df9eee4b-0410-4c9a-955f-5cae73925bac {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:41 devstack sudo[114202]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4ad28cde-7010-4299-88eb-ceedcbe11256 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.347s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4ad28cde-7010-4299-88eb-ceedcbe11256 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:57:41 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-4ad28cde-7010-4299-88eb-ceedcbe11256 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Deleted volume successfully. Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4ad28cde-7010-4299-88eb-ceedcbe11256 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "cinder-291f6dbd-2940-4c07-9569-ab172fd3296b-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:41 devstack sudo[114206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-df9eee4b-0410-4c9a-955f-5cae73925bac Aug 27 03:57:41 devstack sudo[114206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:41 devstack sudo[114204]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3 1073741824" returned: 0 in 0.523s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:41 devstack sudo[114214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3 Aug 27 03:57:41 devstack sudo[114214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e520cd3a-2c7f-46c1-9b7d-5f458704bb0d tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "cinder-9c97d15f-2bec-4963-9de5-6d1a38d3bb55-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:41 devstack sudo[114206]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e520cd3a-2c7f-46c1-9b7d-5f458704bb0d tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-9c97d15f-2bec-4963-9de5-6d1a38d3bb55-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1393ff4e-12d1-4978-bb76-204282d53d0e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-df9eee4b-0410-4c9a-955f-5cae73925bac" returned: 0 in 0.412s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1393ff4e-12d1-4978-bb76-204282d53d0e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-df9eee4b-0410-4c9a-955f-5cae73925bac {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:41 devstack sudo[114217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-df9eee4b-0410-4c9a-955f-5cae73925bac Aug 27 03:57:41 devstack sudo[114217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:41 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e520cd3a-2c7f-46c1-9b7d-5f458704bb0d tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "cinder-quobyte-9c97d15f-2bec-4963-9de5-6d1a38d3bb55" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e520cd3a-2c7f-46c1-9b7d-5f458704bb0d tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-quobyte-9c97d15f-2bec-4963-9de5-6d1a38d3bb55" acquired by "delete_volume" :: waited 0.024s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[866de7ac-1df8-4525-8ae7-c8a1073c6360]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e520cd3a-2c7f-46c1-9b7d-5f458704bb0d tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9c97d15f-2bec-4963-9de5-6d1a38d3bb55 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:42 devstack sudo[114214]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3" returned: 0 in 0.311s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:42 devstack sudo[114219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9c97d15f-2bec-4963-9de5-6d1a38d3bb55 Aug 27 03:57:42 devstack sudo[114219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d666c7c6-d8df-4dea-8df2-a5247c84f8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f21f94-e4ba-4681-89f9-4fbddde47022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7983a5a6-5528-42bd-9a8a-0c36ec4f92e3 tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Acquiring lock "cinder-b79e6294-ff52-4af8-a011-7dd4630a5b4c-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:42 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Volume volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3 (b9c8dc11-9bff-4924-9ac8-40eadef278b3): created successfully Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f21f94-e4ba-4681-89f9-4fbddde47022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:42 devstack sudo[114217]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Flow 'volume_create_manager' (1a554cc6-a9ef-4190-94a5-845c6df5440e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7983a5a6-5528-42bd-9a8a-0c36ec4f92e3 tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Lock "cinder-b79e6294-ff52-4af8-a011-7dd4630a5b4c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1393ff4e-12d1-4978-bb76-204282d53d0e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-df9eee4b-0410-4c9a-955f-5cae73925bac" returned: 0 in 0.353s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:42 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f683bc98-2474-40ef-bffd-a9fa89695fbc tempest-ProjectMemberTests-1426758417 None] Created volume successfully. Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1393ff4e-12d1-4978-bb76-204282d53d0e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "cinder-quobyte-df9eee4b-0410-4c9a-955f-5cae73925bac" released by "delete_volume" :: held 0.829s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7983a5a6-5528-42bd-9a8a-0c36ec4f92e3 tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Acquiring lock "cinder-quobyte-b79e6294-ff52-4af8-a011-7dd4630a5b4c" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7983a5a6-5528-42bd-9a8a-0c36ec4f92e3 tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Lock "cinder-quobyte-b79e6294-ff52-4af8-a011-7dd4630a5b4c" acquired by "delete_volume" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f24a359-b659-4812-927a-8d31e82408b1]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7983a5a6-5528-42bd-9a8a-0c36ec4f92e3 tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b79e6294-ff52-4af8-a011-7dd4630a5b4c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-1393ff4e-12d1-4978-bb76-204282d53d0e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Created reservations ['b6848324-5326-467a-a1da-60f13e24c6b0', '2c0e48b3-9975-4d8b-af8a-522bc60a4d08', 'b979addf-a54c-4d07-8607-08cb90c195b5', '005b0d64-8085-4a24-8ea5-381e5f3e5f5a'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1393ff4e-12d1-4978-bb76-204282d53d0e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1393ff4e-12d1-4978-bb76-204282d53d0e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1393ff4e-12d1-4978-bb76-204282d53d0e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:42 devstack sudo[114219]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1393ff4e-12d1-4978-bb76-204282d53d0e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1393ff4e-12d1-4978-bb76-204282d53d0e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1393ff4e-12d1-4978-bb76-204282d53d0e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e520cd3a-2c7f-46c1-9b7d-5f458704bb0d tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9c97d15f-2bec-4963-9de5-6d1a38d3bb55" returned: 0 in 0.435s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e520cd3a-2c7f-46c1-9b7d-5f458704bb0d tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9c97d15f-2bec-4963-9de5-6d1a38d3bb55 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:42 devstack sudo[114227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:57:42 devstack sudo[114227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:42 devstack sudo[114228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9c97d15f-2bec-4963-9de5-6d1a38d3bb55 Aug 27 03:57:42 devstack sudo[114228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:42 devstack sudo[114224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b79e6294-ff52-4af8-a011-7dd4630a5b4c Aug 27 03:57:42 devstack sudo[114224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-57dfe818-fbb3-4e7c-9d45-9477cb148523 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "cinder-7b6c2a56-886f-4aca-a95d-95ff56f57576-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-57dfe818-fbb3-4e7c-9d45-9477cb148523 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "cinder-7b6c2a56-886f-4aca-a95d-95ff56f57576-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-57dfe818-fbb3-4e7c-9d45-9477cb148523 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "cinder-quobyte-7b6c2a56-886f-4aca-a95d-95ff56f57576" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-57dfe818-fbb3-4e7c-9d45-9477cb148523 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "cinder-quobyte-7b6c2a56-886f-4aca-a95d-95ff56f57576" acquired by "delete_volume" :: waited 0.026s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50a3a19-ab30-4338-baf9-5446692b8089]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-57dfe818-fbb3-4e7c-9d45-9477cb148523 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7b6c2a56-886f-4aca-a95d-95ff56f57576 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:42 devstack sudo[114227]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1393ff4e-12d1-4978-bb76-204282d53d0e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.313s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-1393ff4e-12d1-4978-bb76-204282d53d0e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:57:42 devstack sudo[114228]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e520cd3a-2c7f-46c1-9b7d-5f458704bb0d tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9c97d15f-2bec-4963-9de5-6d1a38d3bb55" returned: 0 in 0.312s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:42 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-1393ff4e-12d1-4978-bb76-204282d53d0e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Deleted volume successfully. Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e520cd3a-2c7f-46c1-9b7d-5f458704bb0d tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-quobyte-9c97d15f-2bec-4963-9de5-6d1a38d3bb55" released by "delete_volume" :: held 0.805s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:42 devstack sudo[114224]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7983a5a6-5528-42bd-9a8a-0c36ec4f92e3 tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b79e6294-ff52-4af8-a011-7dd4630a5b4c" returned: 0 in 0.441s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7983a5a6-5528-42bd-9a8a-0c36ec4f92e3 tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b79e6294-ff52-4af8-a011-7dd4630a5b4c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1393ff4e-12d1-4978-bb76-204282d53d0e tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "cinder-df9eee4b-0410-4c9a-955f-5cae73925bac-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:42 devstack sudo[114239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b79e6294-ff52-4af8-a011-7dd4630a5b4c Aug 27 03:57:42 devstack sudo[114239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-e520cd3a-2c7f-46c1-9b7d-5f458704bb0d tempest-CreateVolumesFromSnapshotTest-1966912875 None] Created reservations ['07d8ea50-56a5-4de3-8e27-ac8d06c7ac97', 'b6ab162a-d7f5-4222-8a31-054f4b8af9f4', 'ecf68729-4dc6-4570-b82c-b308923c0dca', '1abb71a4-b93c-43ee-bd67-2c1a1df46447'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:42 devstack sudo[114238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7b6c2a56-886f-4aca-a95d-95ff56f57576 Aug 27 03:57:42 devstack sudo[114238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e520cd3a-2c7f-46c1-9b7d-5f458704bb0d tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e520cd3a-2c7f-46c1-9b7d-5f458704bb0d tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e520cd3a-2c7f-46c1-9b7d-5f458704bb0d tempest-CreateVolumesFromSnapshotTest-1966912875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e520cd3a-2c7f-46c1-9b7d-5f458704bb0d tempest-CreateVolumesFromSnapshotTest-1966912875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e520cd3a-2c7f-46c1-9b7d-5f458704bb0d tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e520cd3a-2c7f-46c1-9b7d-5f458704bb0d tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:42 devstack sudo[114242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:57:42 devstack sudo[114242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-79b968eb-e197-48a6-add6-ed81899a6fc6 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "cinder-606f9119-3965-4256-8c72-b55994e7b4c9-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:43 devstack sudo[114239]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7983a5a6-5528-42bd-9a8a-0c36ec4f92e3 tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b79e6294-ff52-4af8-a011-7dd4630a5b4c" returned: 0 in 0.296s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-79b968eb-e197-48a6-add6-ed81899a6fc6 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-606f9119-3965-4256-8c72-b55994e7b4c9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7983a5a6-5528-42bd-9a8a-0c36ec4f92e3 tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Lock "cinder-quobyte-b79e6294-ff52-4af8-a011-7dd4630a5b4c" released by "delete_volume" :: held 0.800s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-79b968eb-e197-48a6-add6-ed81899a6fc6 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "cinder-quobyte-606f9119-3965-4256-8c72-b55994e7b4c9" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-79b968eb-e197-48a6-add6-ed81899a6fc6 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-quobyte-606f9119-3965-4256-8c72-b55994e7b4c9" acquired by "delete_volume" :: waited 0.033s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:43 devstack sudo[114238]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-57dfe818-fbb3-4e7c-9d45-9477cb148523 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7b6c2a56-886f-4aca-a95d-95ff56f57576" returned: 0 in 0.492s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:43 devstack sudo[114242]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-57dfe818-fbb3-4e7c-9d45-9477cb148523 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7b6c2a56-886f-4aca-a95d-95ff56f57576 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a78bd5-7b48-4ea9-9e37-68f825c87ba8]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-79b968eb-e197-48a6-add6-ed81899a6fc6 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-606f9119-3965-4256-8c72-b55994e7b4c9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-7983a5a6-5528-42bd-9a8a-0c36ec4f92e3 tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Created reservations ['ac5dca49-e5ba-4d60-8886-093bc0dbe1e2', 'df4998da-d95e-4ed2-b746-e79615ed8b4f', 'd8175f5f-c69d-41ef-810d-bfb99887d042', '8c4ca037-762b-423d-b555-c8e4f250f8bd'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:43 devstack sudo[114250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7b6c2a56-886f-4aca-a95d-95ff56f57576 Aug 27 03:57:43 devstack sudo[114250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e520cd3a-2c7f-46c1-9b7d-5f458704bb0d tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.358s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-e520cd3a-2c7f-46c1-9b7d-5f458704bb0d tempest-CreateVolumesFromSnapshotTest-1966912875 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:57:43 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e520cd3a-2c7f-46c1-9b7d-5f458704bb0d tempest-CreateVolumesFromSnapshotTest-1966912875 None] Deleted volume successfully. Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e520cd3a-2c7f-46c1-9b7d-5f458704bb0d tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-9c97d15f-2bec-4963-9de5-6d1a38d3bb55-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7983a5a6-5528-42bd-9a8a-0c36ec4f92e3 tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7983a5a6-5528-42bd-9a8a-0c36ec4f92e3 tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7983a5a6-5528-42bd-9a8a-0c36ec4f92e3 tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7983a5a6-5528-42bd-9a8a-0c36ec4f92e3 tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7983a5a6-5528-42bd-9a8a-0c36ec4f92e3 tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7983a5a6-5528-42bd-9a8a-0c36ec4f92e3 tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:43 devstack sudo[114251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-606f9119-3965-4256-8c72-b55994e7b4c9 Aug 27 03:57:43 devstack sudo[114251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:43 devstack sudo[114255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:57:43 devstack sudo[114255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:43 devstack sudo[114250]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-57dfe818-fbb3-4e7c-9d45-9477cb148523 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-7b6c2a56-886f-4aca-a95d-95ff56f57576" returned: 0 in 0.368s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-57dfe818-fbb3-4e7c-9d45-9477cb148523 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "cinder-quobyte-7b6c2a56-886f-4aca-a95d-95ff56f57576" released by "delete_volume" :: held 0.905s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e2102f7b-cf4d-42cd-b609-39e24465b0d4 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e2102f7b-cf4d-42cd-b609-39e24465b0d4 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-e2102f7b-cf4d-42cd-b609-39e24465b0d4 tempest-ProjectMemberTests-1426758417 None] Creating offline snapshot b2932395-8a97-4c26-9895-5a3ad344ea2c of volume b9c8dc11-9bff-4924-9ac8-40eadef278b3 {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[207c9049-30a4-4afd-a0f6-385ba064f8f6]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e2102f7b-cf4d-42cd-b609-39e24465b0d4 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-57dfe818-fbb3-4e7c-9d45-9477cb148523 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Created reservations ['d3cbc6a9-0dc7-4343-91c7-6ac564fc9a13', '9de501bd-56fc-4248-a2a0-e05a32fb1426', '6868cd48-0f69-43f5-a25f-412099aadddc', 'fb0a6506-a575-4919-b50c-8f841aaa7722'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:43 devstack sudo[114255]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7983a5a6-5528-42bd-9a8a-0c36ec4f92e3 tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.339s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-7983a5a6-5528-42bd-9a8a-0c36ec4f92e3 tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:57:43 devstack sudo[114251]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-79b968eb-e197-48a6-add6-ed81899a6fc6 tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-606f9119-3965-4256-8c72-b55994e7b4c9" returned: 0 in 0.522s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-79b968eb-e197-48a6-add6-ed81899a6fc6 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-606f9119-3965-4256-8c72-b55994e7b4c9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:43 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-7983a5a6-5528-42bd-9a8a-0c36ec4f92e3 tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Deleted volume successfully. Aug 27 03:57:43 devstack sudo[114264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-606f9119-3965-4256-8c72-b55994e7b4c9 Aug 27 03:57:43 devstack sudo[114264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-7983a5a6-5528-42bd-9a8a-0c36ec4f92e3 tempest-VolumeAndVolumeTypeFromImageTest-1973724903 None] Lock "cinder-b79e6294-ff52-4af8-a011-7dd4630a5b4c-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:43 devstack sudo[114260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3 Aug 27 03:57:43 devstack sudo[114260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-57dfe818-fbb3-4e7c-9d45-9477cb148523 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-57dfe818-fbb3-4e7c-9d45-9477cb148523 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-57dfe818-fbb3-4e7c-9d45-9477cb148523 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-57dfe818-fbb3-4e7c-9d45-9477cb148523 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-57dfe818-fbb3-4e7c-9d45-9477cb148523 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-57dfe818-fbb3-4e7c-9d45-9477cb148523 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:43 devstack sudo[114267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:57:43 devstack sudo[114267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:44 devstack sudo[114264]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-79b968eb-e197-48a6-add6-ed81899a6fc6 tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-606f9119-3965-4256-8c72-b55994e7b4c9" returned: 0 in 0.282s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-79b968eb-e197-48a6-add6-ed81899a6fc6 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-quobyte-606f9119-3965-4256-8c72-b55994e7b4c9" released by "delete_volume" :: held 0.868s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:44 devstack sudo[114260]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e2102f7b-cf4d-42cd-b609-39e24465b0d4 tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3" returned: 0 in 0.430s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e2102f7b-cf4d-42cd-b609-39e24465b0d4 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.b2932395-8a97-4c26-9895-5a3ad344ea2c 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:44 devstack sudo[114267]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-57dfe818-fbb3-4e7c-9d45-9477cb148523 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.264s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-57dfe818-fbb3-4e7c-9d45-9477cb148523 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:57:44 devstack sudo[114274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.b2932395-8a97-4c26-9895-5a3ad344ea2c 1G Aug 27 03:57:44 devstack sudo[114274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:44 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-57dfe818-fbb3-4e7c-9d45-9477cb148523 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Deleted volume successfully. Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-79b968eb-e197-48a6-add6-ed81899a6fc6 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Created reservations ['adb778fc-542f-42c5-b984-5045461f3d04', 'a99dd51f-ec44-4fa9-9eb9-88c1add06185', '75d29010-03e7-42c9-b469-594e50b1f1aa', '4581dd88-3573-411f-a3fd-94f76b5d1dd9'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-57dfe818-fbb3-4e7c-9d45-9477cb148523 tempest-CreateVolumesFromSourceVolumeTest-1722808425 None] Lock "cinder-7b6c2a56-886f-4aca-a95d-95ff56f57576-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-79b968eb-e197-48a6-add6-ed81899a6fc6 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-79b968eb-e197-48a6-add6-ed81899a6fc6 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-79b968eb-e197-48a6-add6-ed81899a6fc6 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-79b968eb-e197-48a6-add6-ed81899a6fc6 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-79b968eb-e197-48a6-add6-ed81899a6fc6 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-79b968eb-e197-48a6-add6-ed81899a6fc6 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:44 devstack sudo[114276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:57:44 devstack sudo[114276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3eea3857-0df6-41ef-87bb-3096eff5b2e2 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "cinder-da5474cf-021b-4ca8-9984-7234ea85d134-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3eea3857-0df6-41ef-87bb-3096eff5b2e2 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-da5474cf-021b-4ca8-9984-7234ea85d134-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3eea3857-0df6-41ef-87bb-3096eff5b2e2 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "cinder-quobyte-da5474cf-021b-4ca8-9984-7234ea85d134" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3eea3857-0df6-41ef-87bb-3096eff5b2e2 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-quobyte-da5474cf-021b-4ca8-9984-7234ea85d134" acquired by "delete_volume" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[29224a35-4564-45a4-9398-0a5e5ba1a069]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3eea3857-0df6-41ef-87bb-3096eff5b2e2 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-da5474cf-021b-4ca8-9984-7234ea85d134 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:44 devstack sudo[114281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-da5474cf-021b-4ca8-9984-7234ea85d134 Aug 27 03:57:44 devstack sudo[114281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:44 devstack sudo[114276]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-79b968eb-e197-48a6-add6-ed81899a6fc6 tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.383s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-79b968eb-e197-48a6-add6-ed81899a6fc6 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:57:44 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-79b968eb-e197-48a6-add6-ed81899a6fc6 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Deleted volume successfully. Aug 27 03:57:44 devstack sudo[114274]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e2102f7b-cf4d-42cd-b609-39e24465b0d4 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.b2932395-8a97-4c26-9895-5a3ad344ea2c 1G" returned: 0 in 0.561s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e2102f7b-cf4d-42cd-b609-39e24465b0d4 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.b2932395-8a97-4c26-9895-5a3ad344ea2c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-79b968eb-e197-48a6-add6-ed81899a6fc6 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-606f9119-3965-4256-8c72-b55994e7b4c9-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:44 devstack sudo[114285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.b2932395-8a97-4c26-9895-5a3ad344ea2c Aug 27 03:57:44 devstack sudo[114285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:44 devstack sudo[114281]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3eea3857-0df6-41ef-87bb-3096eff5b2e2 tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-da5474cf-021b-4ca8-9984-7234ea85d134" returned: 0 in 0.434s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3eea3857-0df6-41ef-87bb-3096eff5b2e2 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-da5474cf-021b-4ca8-9984-7234ea85d134 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:44 devstack sudo[114290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-da5474cf-021b-4ca8-9984-7234ea85d134 Aug 27 03:57:44 devstack sudo[114290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:45 devstack sudo[114285]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e2102f7b-cf4d-42cd-b609-39e24465b0d4 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.b2932395-8a97-4c26-9895-5a3ad344ea2c" returned: 0 in 0.365s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:45 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-e2102f7b-cf4d-42cd-b609-39e24465b0d4 tempest-ProjectMemberTests-1426758417 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.b2932395-8a97-4c26-9895-5a3ad344ea2c is being set with open permissions: ugo+rw Aug 27 03:57:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e2102f7b-cf4d-42cd-b609-39e24465b0d4 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.b2932395-8a97-4c26-9895-5a3ad344ea2c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:45 devstack sudo[114296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.b2932395-8a97-4c26-9895-5a3ad344ea2c Aug 27 03:57:45 devstack sudo[114296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:45 devstack sudo[114290]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3eea3857-0df6-41ef-87bb-3096eff5b2e2 tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-da5474cf-021b-4ca8-9984-7234ea85d134" returned: 0 in 0.319s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3eea3857-0df6-41ef-87bb-3096eff5b2e2 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-quobyte-da5474cf-021b-4ca8-9984-7234ea85d134" released by "delete_volume" :: held 0.806s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:45 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-3eea3857-0df6-41ef-87bb-3096eff5b2e2 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Created reservations ['19b5bb14-de04-4b84-882c-af645fd6c5ef', '42ad31a7-7130-480e-a613-3deaf207faf5', 'a60b827f-493b-4368-9840-dd9111c74f83', '6d3f2596-6538-4eaa-8430-2c5503ce4082'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:45 devstack sudo[114296]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e2102f7b-cf4d-42cd-b609-39e24465b0d4 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.b2932395-8a97-4c26-9895-5a3ad344ea2c" returned: 0 in 0.289s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e2102f7b-cf4d-42cd-b609-39e24465b0d4 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:45 devstack sudo[114300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.info Aug 27 03:57:45 devstack sudo[114300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3eea3857-0df6-41ef-87bb-3096eff5b2e2 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3eea3857-0df6-41ef-87bb-3096eff5b2e2 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:45 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3eea3857-0df6-41ef-87bb-3096eff5b2e2 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:45 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3eea3857-0df6-41ef-87bb-3096eff5b2e2 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3eea3857-0df6-41ef-87bb-3096eff5b2e2 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3eea3857-0df6-41ef-87bb-3096eff5b2e2 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:45 devstack sudo[114302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:57:45 devstack sudo[114302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e1f91564-f104-4d7b-a590-26a26306231a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "cinder-e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e1f91564-f104-4d7b-a590-26a26306231a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e1f91564-f104-4d7b-a590-26a26306231a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "cinder-quobyte-e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e1f91564-f104-4d7b-a590-26a26306231a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-quobyte-e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2" acquired by "delete_volume" :: waited 0.049s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:45 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[9915db92-d5d8-4cf8-b5c0-e4405eb8f5a9]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e1f91564-f104-4d7b-a590-26a26306231a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:45 devstack sudo[114300]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:45 devstack sudo[114302]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e2102f7b-cf4d-42cd-b609-39e24465b0d4 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.info" returned: 0 in 0.448s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:45 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-e2102f7b-cf4d-42cd-b609-39e24465b0d4 tempest-ProjectMemberTests-1426758417 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.info is being set with open permissions: ugo+rw Aug 27 03:57:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e2102f7b-cf4d-42cd-b609-39e24465b0d4 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3eea3857-0df6-41ef-87bb-3096eff5b2e2 tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.402s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:45 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-3eea3857-0df6-41ef-87bb-3096eff5b2e2 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:57:45 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-3eea3857-0df6-41ef-87bb-3096eff5b2e2 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Deleted volume successfully. Aug 27 03:57:45 devstack sudo[114307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.info Aug 27 03:57:45 devstack sudo[114307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3eea3857-0df6-41ef-87bb-3096eff5b2e2 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-da5474cf-021b-4ca8-9984-7234ea85d134-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:45 devstack sudo[114306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2 Aug 27 03:57:45 devstack sudo[114306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:46 devstack sudo[114307]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e2102f7b-cf4d-42cd-b609-39e24465b0d4 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.info" returned: 0 in 0.341s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e2102f7b-cf4d-42cd-b609-39e24465b0d4 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.531s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:46 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e2102f7b-cf4d-42cd-b609-39e24465b0d4 tempest-ProjectMemberTests-1426758417 None] Create snapshot completed successfully Aug 27 03:57:46 devstack sudo[114306]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e1f91564-f104-4d7b-a590-26a26306231a tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2" returned: 0 in 0.495s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e1f91564-f104-4d7b-a590-26a26306231a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:46 devstack sudo[114316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2 Aug 27 03:57:46 devstack sudo[114316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:46 devstack sudo[114316]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e1f91564-f104-4d7b-a590-26a26306231a tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2" returned: 0 in 0.274s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:46 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e1f91564-f104-4d7b-a590-26a26306231a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-quobyte-e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2" released by "delete_volume" :: held 0.837s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:46 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-e1f91564-f104-4d7b-a590-26a26306231a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Created reservations ['8503236a-acc8-42b3-8aae-0f69681883c6', 'd47637f5-454c-4ee2-a16c-37969cd050ae', '63a90b67-e5a1-480d-985b-8693cbfef418', '30568239-5e3a-4ebc-9feb-8428e768365f'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e1f91564-f104-4d7b-a590-26a26306231a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e1f91564-f104-4d7b-a590-26a26306231a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:46 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e1f91564-f104-4d7b-a590-26a26306231a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:46 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e1f91564-f104-4d7b-a590-26a26306231a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e1f91564-f104-4d7b-a590-26a26306231a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e1f91564-f104-4d7b-a590-26a26306231a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:46 devstack sudo[114319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:57:46 devstack sudo[114319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:46 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1e376253-473d-4a08-89b0-be13a1d31f5a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "cinder-9db036b1-ed35-4fec-addb-36a94f601410-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:46 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0de1e7ff-4958-462b-8728-e5cb5ff14d82 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-b2932395-8a97-4c26-9895-5a3ad344ea2c-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:46 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1e376253-473d-4a08-89b0-be13a1d31f5a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-9db036b1-ed35-4fec-addb-36a94f601410-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:46 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0de1e7ff-4958-462b-8728-e5cb5ff14d82 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-b2932395-8a97-4c26-9895-5a3ad344ea2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:46 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0de1e7ff-4958-462b-8728-e5cb5ff14d82 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-b9c8dc11-9bff-4924-9ac8-40eadef278b3" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:47 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0de1e7ff-4958-462b-8728-e5cb5ff14d82 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-b9c8dc11-9bff-4924-9ac8-40eadef278b3" acquired by "delete_snapshot" :: waited 0.056s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:47 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0de1e7ff-4958-462b-8728-e5cb5ff14d82 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-b2932395-8a97-4c26-9895-5a3ad344ea2c" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:47 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1e376253-473d-4a08-89b0-be13a1d31f5a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "cinder-quobyte-9db036b1-ed35-4fec-addb-36a94f601410" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:47 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0de1e7ff-4958-462b-8728-e5cb5ff14d82 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-b2932395-8a97-4c26-9895-5a3ad344ea2c" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:47 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-0de1e7ff-4958-462b-8728-e5cb5ff14d82 tempest-ProjectMemberTests-1426758417 None] Deleting offline snapshot b2932395-8a97-4c26-9895-5a3ad344ea2c of volume b9c8dc11-9bff-4924-9ac8-40eadef278b3 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:57:47 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-0de1e7ff-4958-462b-8728-e5cb5ff14d82 tempest-ProjectMemberTests-1426758417 None] snapshot_file for this snap is: volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.b2932395-8a97-4c26-9895-5a3ad344ea2c {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:57:47 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1e376253-473d-4a08-89b0-be13a1d31f5a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-quobyte-9db036b1-ed35-4fec-addb-36a94f601410" acquired by "delete_volume" :: waited 0.075s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:47 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d7e872-6105-4bb1-bcf3-f1984cab31ff]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0de1e7ff-4958-462b-8728-e5cb5ff14d82 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.b2932395-8a97-4c26-9895-5a3ad344ea2c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:47 devstack sudo[114319]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:47 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d5b26e-9597-4972-a6b9-9aa1cf38bf61]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1e376253-473d-4a08-89b0-be13a1d31f5a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9db036b1-ed35-4fec-addb-36a94f601410 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e1f91564-f104-4d7b-a590-26a26306231a tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.455s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:47 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-e1f91564-f104-4d7b-a590-26a26306231a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:57:47 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e1f91564-f104-4d7b-a590-26a26306231a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Deleted volume successfully. Aug 27 03:57:47 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e1f91564-f104-4d7b-a590-26a26306231a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-e8dfbf1c-5d94-4544-b2f0-b4fc8c6a89f2-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:47 devstack sudo[114323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9db036b1-ed35-4fec-addb-36a94f601410 Aug 27 03:57:47 devstack sudo[114322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.b2932395-8a97-4c26-9895-5a3ad344ea2c Aug 27 03:57:47 devstack sudo[114322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:47 devstack sudo[114323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:47 devstack sudo[114322]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0de1e7ff-4958-462b-8728-e5cb5ff14d82 tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.b2932395-8a97-4c26-9895-5a3ad344ea2c" returned: 0 in 0.507s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:47 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-0de1e7ff-4958-462b-8728-e5cb5ff14d82 tempest-ProjectMemberTests-1426758417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:57:47 devstack sudo[114323]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:47 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fba483e-7004-4c41-bc74-07f89d8a7477]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0de1e7ff-4958-462b-8728-e5cb5ff14d82 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1e376253-473d-4a08-89b0-be13a1d31f5a tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9db036b1-ed35-4fec-addb-36a94f601410" returned: 0 in 0.537s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1e376253-473d-4a08-89b0-be13a1d31f5a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9db036b1-ed35-4fec-addb-36a94f601410 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:47 devstack sudo[114333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9db036b1-ed35-4fec-addb-36a94f601410 Aug 27 03:57:47 devstack sudo[114333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:47 devstack sudo[114332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3 Aug 27 03:57:47 devstack sudo[114332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:48 devstack sudo[114333]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1e376253-473d-4a08-89b0-be13a1d31f5a tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9db036b1-ed35-4fec-addb-36a94f601410" returned: 0 in 0.294s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1e376253-473d-4a08-89b0-be13a1d31f5a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-quobyte-9db036b1-ed35-4fec-addb-36a94f601410" released by "delete_volume" :: held 0.909s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:48 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-1e376253-473d-4a08-89b0-be13a1d31f5a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Created reservations ['abdb6589-af8a-41b6-99f3-a901fd2efb82', 'e8254ecb-5348-4c81-8fac-0c83dc286769', 'a05047ae-efc7-4a6d-b0bc-e099b41b241f', '0fa649ed-cba7-48c9-9834-c19d1a9769c3'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1e376253-473d-4a08-89b0-be13a1d31f5a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1e376253-473d-4a08-89b0-be13a1d31f5a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1e376253-473d-4a08-89b0-be13a1d31f5a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:48 devstack sudo[114332]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1e376253-473d-4a08-89b0-be13a1d31f5a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1e376253-473d-4a08-89b0-be13a1d31f5a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1e376253-473d-4a08-89b0-be13a1d31f5a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0de1e7ff-4958-462b-8728-e5cb5ff14d82 tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3" returned: 0 in 0.538s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0de1e7ff-4958-462b-8728-e5cb5ff14d82 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.b2932395-8a97-4c26-9895-5a3ad344ea2c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:48 devstack sudo[114340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:57:48 devstack sudo[114340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:48 devstack sudo[114341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.b2932395-8a97-4c26-9895-5a3ad344ea2c Aug 27 03:57:48 devstack sudo[114341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:48 devstack sudo[114340]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1e376253-473d-4a08-89b0-be13a1d31f5a tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.307s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:48 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-1e376253-473d-4a08-89b0-be13a1d31f5a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:57:48 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-1e376253-473d-4a08-89b0-be13a1d31f5a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Deleted volume successfully. Aug 27 03:57:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1e376253-473d-4a08-89b0-be13a1d31f5a tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-9db036b1-ed35-4fec-addb-36a94f601410-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:48 devstack sudo[114341]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0de1e7ff-4958-462b-8728-e5cb5ff14d82 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.b2932395-8a97-4c26-9895-5a3ad344ea2c" returned: 0 in 0.402s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0de1e7ff-4958-462b-8728-e5cb5ff14d82 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.b2932395-8a97-4c26-9895-5a3ad344ea2c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:48 devstack sudo[114349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.b2932395-8a97-4c26-9895-5a3ad344ea2c Aug 27 03:57:48 devstack sudo[114349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:48 devstack sudo[114349]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0de1e7ff-4958-462b-8728-e5cb5ff14d82 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3.b2932395-8a97-4c26-9895-5a3ad344ea2c" returned: 0 in 0.294s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0de1e7ff-4958-462b-8728-e5cb5ff14d82 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-b2932395-8a97-4c26-9895-5a3ad344ea2c" released by "_delete_snapshot" :: held 1.914s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:48 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0de1e7ff-4958-462b-8728-e5cb5ff14d82 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-b9c8dc11-9bff-4924-9ac8-40eadef278b3" released by "delete_snapshot" :: held 1.962s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:49 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-0de1e7ff-4958-462b-8728-e5cb5ff14d82 tempest-ProjectMemberTests-1426758417 None] Created reservations ['e64cb0c0-9e0d-45f8-bae0-2445a637f7dc', 'f4f73354-af6a-4ebb-85fe-228f925ba0ed', '693ed501-e6c8-4c29-be0d-e487792cb6f9', 'c2620bec-77cf-45fd-b8e6-2680c59a7e59'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:49 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-0de1e7ff-4958-462b-8728-e5cb5ff14d82 tempest-ProjectMemberTests-1426758417 None] Delete snapshot completed successfully. Aug 27 03:57:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0de1e7ff-4958-462b-8728-e5cb5ff14d82 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-b2932395-8a97-4c26-9895-5a3ad344ea2c-delete_snapshot" released by "delete_snapshot" :: held 2.177s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c2bf1553-b444-4977-97a1-993e411f8106 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "cinder-e2eea03c-4a3c-4b4e-860f-a793ec49c0fa-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c2bf1553-b444-4977-97a1-993e411f8106 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-e2eea03c-4a3c-4b4e-860f-a793ec49c0fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c2bf1553-b444-4977-97a1-993e411f8106 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "cinder-quobyte-f4d3444f-ec0d-4663-bbc4-5d9d6455071d" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c2bf1553-b444-4977-97a1-993e411f8106 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-quobyte-f4d3444f-ec0d-4663-bbc4-5d9d6455071d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c2bf1553-b444-4977-97a1-993e411f8106 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "cinder-quobyte-e2eea03c-4a3c-4b4e-860f-a793ec49c0fa" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c2bf1553-b444-4977-97a1-993e411f8106 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-quobyte-e2eea03c-4a3c-4b4e-860f-a793ec49c0fa" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:49 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-c2bf1553-b444-4977-97a1-993e411f8106 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Deleting offline snapshot e2eea03c-4a3c-4b4e-860f-a793ec49c0fa of volume f4d3444f-ec0d-4663-bbc4-5d9d6455071d {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:57:49 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-c2bf1553-b444-4977-97a1-993e411f8106 tempest-CreateVolumesFromSnapshotTest-1966912875 None] snapshot_file for this snap is: volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.e2eea03c-4a3c-4b4e-860f-a793ec49c0fa {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:57:49 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[15864370-90b3-44bd-9095-6f89681fa8a7]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c2bf1553-b444-4977-97a1-993e411f8106 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.e2eea03c-4a3c-4b4e-860f-a793ec49c0fa {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:49 devstack sudo[114352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.e2eea03c-4a3c-4b4e-860f-a793ec49c0fa Aug 27 03:57:49 devstack sudo[114352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:49 devstack sudo[114352]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c2bf1553-b444-4977-97a1-993e411f8106 tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.e2eea03c-4a3c-4b4e-860f-a793ec49c0fa" returned: 0 in 0.399s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:49 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-c2bf1553-b444-4977-97a1-993e411f8106 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:57:49 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b4ef06-61cb-4318-a541-2dbbb65359c2]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c2bf1553-b444-4977-97a1-993e411f8106 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:49 devstack sudo[114357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d Aug 27 03:57:49 devstack sudo[114357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Flow 'volume_create_manager' (1bc919d0-9acd-42ac-857d-f18587e629ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20c7676-dbe0-46c1-b7c2-cd0e8c53ad7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-fd004ffe-58b5-4334-9b9c-b2facc39623d tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-b9c8dc11-9bff-4924-9ac8-40eadef278b3-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:50 devstack sudo[114357]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c2bf1553-b444-4977-97a1-993e411f8106 tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d" returned: 0 in 0.512s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c2bf1553-b444-4977-97a1-993e411f8106 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.e2eea03c-4a3c-4b4e-860f-a793ec49c0fa {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20c7676-dbe0-46c1-b7c2-cd0e8c53ad7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1921861623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26c77ed-b8f9-4984-b735-797e0b49f411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307b668446d24188b4f630371588fa06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:50Z,use_quota=True,user_id='a81a46b57dbf4f5ab3f34a30072c8da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4924993d-dc66-44de-9f5b-6eee203cb082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4924993d-dc66-44de-9f5b-6eee203cb082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a681b517-be85-491f-b3b2-a856c60a8596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:50 devstack sudo[114362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.e2eea03c-4a3c-4b4e-860f-a793ec49c0fa Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a681b517-be85-491f-b3b2-a856c60a8596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e26c77ed-b8f9-4984-b735-797e0b49f411', 'volume_name': 'volume-e26c77ed-b8f9-4984-b735-797e0b49f411', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:50 devstack sudo[114362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34171574-8786-4434-84ab-2cbe82262eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34171574-8786-4434-84ab-2cbe82262eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e76b8d-d103-4f4d-a87e-977a8191b338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:50 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Volume e26c77ed-b8f9-4984-b735-797e0b49f411: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e26c77ed-b8f9-4984-b735-797e0b49f411', 'volume_size': 1} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1921861623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26c77ed-b8f9-4984-b735-797e0b49f411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307b668446d24188b4f630371588fa06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:50Z,use_quota=True,user_id='a81a46b57dbf4f5ab3f34a30072c8da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Creating volume e26c77ed-b8f9-4984-b735-797e0b49f411 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:50 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e26c77ed-b8f9-4984-b735-797e0b49f411 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-fd004ffe-58b5-4334-9b9c-b2facc39623d tempest-ProjectMemberTests-1426758417 None] Lock "cinder-b9c8dc11-9bff-4924-9ac8-40eadef278b3-delete_volume" acquired by "delete_volume" :: waited 0.167s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:50 devstack sudo[114364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e26c77ed-b8f9-4984-b735-797e0b49f411 1073741824 Aug 27 03:57:50 devstack sudo[114364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-fd004ffe-58b5-4334-9b9c-b2facc39623d tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-b9c8dc11-9bff-4924-9ac8-40eadef278b3" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-fd004ffe-58b5-4334-9b9c-b2facc39623d tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-b9c8dc11-9bff-4924-9ac8-40eadef278b3" acquired by "delete_volume" :: waited 0.028s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[1118618f-fa45-4bbf-a3fd-589a1755194f]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fd004ffe-58b5-4334-9b9c-b2facc39623d tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Flow 'volume_create_manager' (70a0328a-ba6a-409f-bc6b-e531fe35b1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:50 devstack sudo[114366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3 Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622b4a92-5c55-45e3-9ab5-1cd5f82aa4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:50 devstack sudo[114366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622b4a92-5c55-45e3-9ab5-1cd5f82aa4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-195462811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d6af11-c9e4-4364-a2f2-7d1541be73c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307b668446d24188b4f630371588fa06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:51Z,use_quota=True,user_id='a81a46b57dbf4f5ab3f34a30072c8da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218570d8-ceb3-4f50-bdc5-4f9bc3cb8257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218570d8-ceb3-4f50-bdc5-4f9bc3cb8257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d869e59-5a45-41d0-9f05-137bd9cfc848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d869e59-5a45-41d0-9f05-137bd9cfc848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29d6af11-c9e4-4364-a2f2-7d1541be73c2', 'volume_name': 'volume-29d6af11-c9e4-4364-a2f2-7d1541be73c2', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45768cc5-312b-4f69-af4d-815a6ac69f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45768cc5-312b-4f69-af4d-815a6ac69f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b87210-87d1-4445-a9e6-b04860951cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:50 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Volume 29d6af11-c9e4-4364-a2f2-7d1541be73c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29d6af11-c9e4-4364-a2f2-7d1541be73c2', 'volume_size': 1} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:50 devstack sudo[114362]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c2bf1553-b444-4977-97a1-993e411f8106 tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.e2eea03c-4a3c-4b4e-860f-a793ec49c0fa" returned: 0 in 0.705s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c2bf1553-b444-4977-97a1-993e411f8106 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.e2eea03c-4a3c-4b4e-860f-a793ec49c0fa {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:51 devstack sudo[114374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.e2eea03c-4a3c-4b4e-860f-a793ec49c0fa Aug 27 03:57:51 devstack sudo[114374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:51 devstack sudo[114366]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fd004ffe-58b5-4334-9b9c-b2facc39623d tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3" returned: 0 in 0.560s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fd004ffe-58b5-4334-9b9c-b2facc39623d tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:51 devstack sudo[114364]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:51 devstack sudo[114381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3 Aug 27 03:57:51 devstack sudo[114381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e26c77ed-b8f9-4984-b735-797e0b49f411 1073741824" returned: 0 in 0.800s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e26c77ed-b8f9-4984-b735-797e0b49f411 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:51 devstack sudo[114374]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:51 devstack sudo[114384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e26c77ed-b8f9-4984-b735-797e0b49f411 Aug 27 03:57:51 devstack sudo[114384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Flow 'volume_create_manager' (48d76f02-fb72-49b7-963d-2ef3e1d950c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0edae383-8568-4114-b220-90b80f17fb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c2bf1553-b444-4977-97a1-993e411f8106 tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d.e2eea03c-4a3c-4b4e-860f-a793ec49c0fa" returned: 0 in 0.430s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0edae383-8568-4114-b220-90b80f17fb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1459445113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37370a20-1567-48e6-a5cb-efe38f23d097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307b668446d24188b4f630371588fa06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:51Z,use_quota=True,user_id='a81a46b57dbf4f5ab3f34a30072c8da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be17cec2-495e-4bd7-920b-4f7aaaefd740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be17cec2-495e-4bd7-920b-4f7aaaefd740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ada4c5e-028e-466c-8e1e-af715a1bce86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ada4c5e-028e-466c-8e1e-af715a1bce86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37370a20-1567-48e6-a5cb-efe38f23d097', 'volume_name': 'volume-37370a20-1567-48e6-a5cb-efe38f23d097', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5708f255-2646-4788-aad1-12ff2314f0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5708f255-2646-4788-aad1-12ff2314f0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (236333ca-c1d1-4638-8bfc-91ccbcffae01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:51 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Volume 37370a20-1567-48e6-a5cb-efe38f23d097: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37370a20-1567-48e6-a5cb-efe38f23d097', 'volume_size': 1} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c2bf1553-b444-4977-97a1-993e411f8106 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-quobyte-e2eea03c-4a3c-4b4e-860f-a793ec49c0fa" released by "_delete_snapshot" :: held 2.344s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c2bf1553-b444-4977-97a1-993e411f8106 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-quobyte-f4d3444f-ec0d-4663-bbc4-5d9d6455071d" released by "delete_snapshot" :: held 2.382s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:51 devstack sudo[114384]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e26c77ed-b8f9-4984-b735-797e0b49f411" returned: 0 in 0.412s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.817s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:51 devstack sudo[114381]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-195462811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d6af11-c9e4-4364-a2f2-7d1541be73c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307b668446d24188b4f630371588fa06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:51Z,use_quota=True,user_id='a81a46b57dbf4f5ab3f34a30072c8da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Creating volume 29d6af11-c9e4-4364-a2f2-7d1541be73c2 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:51 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-29d6af11-c9e4-4364-a2f2-7d1541be73c2 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fd004ffe-58b5-4334-9b9c-b2facc39623d tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b9c8dc11-9bff-4924-9ac8-40eadef278b3" returned: 0 in 0.637s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:51 devstack sudo[114388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-29d6af11-c9e4-4364-a2f2-7d1541be73c2 1073741824 Aug 27 03:57:51 devstack sudo[114388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e76b8d-d103-4f4d-a87e-977a8191b338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e26c77ed-b8f9-4984-b735-797e0b49f411', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117925c1-cecf-463e-bee6-67b7d13f4716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:51 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Volume volume-e26c77ed-b8f9-4984-b735-797e0b49f411 (e26c77ed-b8f9-4984-b735-797e0b49f411): created successfully Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117925c1-cecf-463e-bee6-67b7d13f4716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Flow 'volume_create_manager' (1bc919d0-9acd-42ac-857d-f18587e629ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-fd004ffe-58b5-4334-9b9c-b2facc39623d tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-b9c8dc11-9bff-4924-9ac8-40eadef278b3" released by "delete_volume" :: held 1.336s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:51 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-3254587c-445b-4368-aa46-69ddee280c11 tempest-CreateVolumesFromImageTest-263987185 None] Created volume successfully. Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-c2bf1553-b444-4977-97a1-993e411f8106 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Created reservations ['54152223-186f-478a-9a65-5f9471aa81ac', 'd833467a-e0cc-4e72-ad63-615396701fe2', 'cb7a6732-6c73-43d4-9892-4e01d42f0550', '0598230d-a416-4925-886f-5fcc229e6104'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:51 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-fd004ffe-58b5-4334-9b9c-b2facc39623d tempest-ProjectMemberTests-1426758417 None] Created reservations ['8cc2f669-63bd-4f65-a7e0-28e6979560b1', '176df717-b45f-4d34-bd0b-b4be59119236', '7d6150a1-9499-4699-9498-b88f07c632eb', '3b77a690-a7b7-4cc3-9947-6e37a3ccd20b'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:52 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-c2bf1553-b444-4977-97a1-993e411f8106 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Delete snapshot completed successfully. Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c2bf1553-b444-4977-97a1-993e411f8106 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-e2eea03c-4a3c-4b4e-860f-a793ec49c0fa-delete_snapshot" released by "delete_snapshot" :: held 2.780s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Flow 'volume_create_manager' (3dbff0cb-ede8-431c-95ec-2f33e846fc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366f59f3-a782-44f7-a842-d9b58e745360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366f59f3-a782-44f7-a842-d9b58e745360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-76687658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c36439-8a2f-437f-8911-1777f39abc33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307b668446d24188b4f630371588fa06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:52Z,use_quota=True,user_id='a81a46b57dbf4f5ab3f34a30072c8da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b870356-9f0b-42ee-a8f8-58626780748e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b870356-9f0b-42ee-a8f8-58626780748e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2e4df3-f354-445a-aee0-fcdf663804d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2e4df3-f354-445a-aee0-fcdf663804d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65c36439-8a2f-437f-8911-1777f39abc33', 'volume_name': 'volume-65c36439-8a2f-437f-8911-1777f39abc33', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b09ab9-38ea-45b8-a4e7-694675cebb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b09ab9-38ea-45b8-a4e7-694675cebb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a2001e-82ac-4667-9cce-e88b98eb0aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:52 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Volume 65c36439-8a2f-437f-8911-1777f39abc33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65c36439-8a2f-437f-8911-1777f39abc33', 'volume_size': 1} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fd004ffe-58b5-4334-9b9c-b2facc39623d tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fd004ffe-58b5-4334-9b9c-b2facc39623d tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-fd004ffe-58b5-4334-9b9c-b2facc39623d tempest-ProjectMemberTests-1426758417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-fd004ffe-58b5-4334-9b9c-b2facc39623d tempest-ProjectMemberTests-1426758417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fd004ffe-58b5-4334-9b9c-b2facc39623d tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fd004ffe-58b5-4334-9b9c-b2facc39623d tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:52 devstack sudo[114393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:57:52 devstack sudo[114393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Flow 'volume_create_manager' (2646f47b-7289-4cc2-b08b-c4b0b43aa31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9998358a-2a9f-4d0a-a2cb-4fcf590344bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9998358a-2a9f-4d0a-a2cb-4fcf590344bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d252714e-d0cc-434d-bced-c1782583bb15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='989f60114eab45fbac34dd160a986f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:52Z,use_quota=True,user_id='ed3de510a25a4d8ba62bb1900cf65792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c3efa0-edae-40be-9ece-d48499b8b0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c3efa0-edae-40be-9ece-d48499b8b0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b5f021-e0a6-42a5-9226-0d3967e13b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.image.glance [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Creating Keystone auth plugin from conf {{(pid=94328) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Flow 'volume_create_manager' (ddb73ea2-136c-4960-b2b7-566f8e8edec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635155af-868c-431a-aeb4-eb7a98ee0479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635155af-868c-431a-aeb4-eb7a98ee0479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-217735279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307b668446d24188b4f630371588fa06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:52Z,use_quota=True,user_id='a81a46b57dbf4f5ab3f34a30072c8da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d13927f-0eb7-4991-953f-38e7d481124e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d13927f-0eb7-4991-953f-38e7d481124e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e411f73c-e664-4340-a309-df0a6b90f455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e411f73c-e664-4340-a309-df0a6b90f455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd78546ce-3ac2-4a9e-be5b-2ab26b6d19a0', 'volume_name': 'volume-d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:52 devstack sudo[114388]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f9e830-2b83-4c30-b5d9-e6c1a3226bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f9e830-2b83-4c30-b5d9-e6c1a3226bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe102e02-afb6-4e75-87e4-5cf923daa588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:52 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Volume d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0', 'volume_size': 1} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-29d6af11-c9e4-4364-a2f2-7d1541be73c2 1073741824" returned: 0 in 0.660s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-29d6af11-c9e4-4364-a2f2-7d1541be73c2 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:52 devstack sudo[114395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-29d6af11-c9e4-4364-a2f2-7d1541be73c2 Aug 27 03:57:52 devstack sudo[114395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:52 devstack sudo[114393]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fd004ffe-58b5-4334-9b9c-b2facc39623d tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.331s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-fd004ffe-58b5-4334-9b9c-b2facc39623d tempest-ProjectMemberTests-1426758417 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:57:52 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-fd004ffe-58b5-4334-9b9c-b2facc39623d tempest-ProjectMemberTests-1426758417 None] Deleted volume successfully. Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-fd004ffe-58b5-4334-9b9c-b2facc39623d tempest-ProjectMemberTests-1426758417 None] Lock "cinder-b9c8dc11-9bff-4924-9ac8-40eadef278b3-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b5f021-e0a6-42a5-9226-0d3967e13b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd252714e-d0cc-434d-bced-c1782583bb15', 'volume_name': 'volume-d252714e-d0cc-434d-bced-c1782583bb15', 'volume_size': 1, 'image_id': '4b5d3cba-d3c5-44f2-809d-ffec6a931a78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b5d3cba-d3c5-44f2-809d-ffec6a931a78', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c68e25d29a1bba5343d5548df367802c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '989f60114eab45fbac34dd160a986f48', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2cd9af5f95f84507b4e5f51ec0575d97944233c20c16ecb2136f02b05a1709cfd3a5bbb94ed389378286020a610161019bb1892d79f8f692e511f26c6d553a0d', 'id': '4b5d3cba-d3c5-44f2-809d-ffec6a931a78', 'created_at': datetime.datetime(2026, 8, 27, 1, 57, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 57, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b5d3cba-d3c5-44f2-809d-ffec6a931a78/file', 'properties': {}}, 'image_service': }' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db3cb22b-2786-47d5-b429-24c58973c627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db3cb22b-2786-47d5-b429-24c58973c627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8af78ec-2b72-42c4-8293-04d2bdb7e59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:52 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Volume d252714e-d0cc-434d-bced-c1782583bb15: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d252714e-d0cc-434d-bced-c1782583bb15', 'volume_size': 1, 'image_id': '4b5d3cba-d3c5-44f2-809d-ffec6a931a78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b5d3cba-d3c5-44f2-809d-ffec6a931a78', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c68e25d29a1bba5343d5548df367802c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '989f60114eab45fbac34dd160a986f48', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2cd9af5f95f84507b4e5f51ec0575d97944233c20c16ecb2136f02b05a1709cfd3a5bbb94ed389378286020a610161019bb1892d79f8f692e511f26c6d553a0d', 'id': '4b5d3cba-d3c5-44f2-809d-ffec6a931a78', 'created_at': datetime.datetime(2026, 8, 27, 1, 57, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 57, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b5d3cba-d3c5-44f2-809d-ffec6a931a78/file', 'properties': {}}, 'image_service': } Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Trying to clone d252714e-d0cc-434d-bced-c1782583bb15 from image 4b5d3cba-d3c5-44f2-809d-ffec6a931a78 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4b5d3cba-d3c5-44f2-809d-ffec6a931a78', 'metadata': {}}]). {{(pid=94328) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 27 03:57:52 devstack sudo[114395]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-29d6af11-c9e4-4364-a2f2-7d1541be73c2" returned: 0 in 0.278s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.136s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1459445113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37370a20-1567-48e6-a5cb-efe38f23d097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307b668446d24188b4f630371588fa06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:51Z,use_quota=True,user_id='a81a46b57dbf4f5ab3f34a30072c8da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Creating volume 37370a20-1567-48e6-a5cb-efe38f23d097 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:52 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-37370a20-1567-48e6-a5cb-efe38f23d097 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1d39d1e7-d08c-42a3-bdba-8543632c2a25 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "cinder-f4d3444f-ec0d-4663-bbc4-5d9d6455071d-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:52 devstack sudo[114399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-37370a20-1567-48e6-a5cb-efe38f23d097 1073741824 Aug 27 03:57:52 devstack sudo[114399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b87210-87d1-4445-a9e6-b04860951cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29d6af11-c9e4-4364-a2f2-7d1541be73c2', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ba8ccb-4384-4990-8b0f-e8c0a35a2aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 27 03:57:52 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Image download 0.00 MB at 0.00 MB/s Aug 27 03:57:52 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Volume volume-29d6af11-c9e4-4364-a2f2-7d1541be73c2 (29d6af11-c9e4-4364-a2f2-7d1541be73c2): created successfully Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ba8ccb-4384-4990-8b0f-e8c0a35a2aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Flow 'volume_create_manager' (70a0328a-ba6a-409f-bc6b-e531fe35b1e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1d39d1e7-d08c-42a3-bdba-8543632c2a25 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-f4d3444f-ec0d-4663-bbc4-5d9d6455071d-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:52 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-846fae88-d3f9-479f-9383-1e36296f37c2 tempest-CreateVolumesFromImageTest-263987185 None] Created volume successfully. Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1d39d1e7-d08c-42a3-bdba-8543632c2a25 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "cinder-quobyte-f4d3444f-ec0d-4663-bbc4-5d9d6455071d" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1d39d1e7-d08c-42a3-bdba-8543632c2a25 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-quobyte-f4d3444f-ec0d-4663-bbc4-5d9d6455071d" acquired by "delete_volume" :: waited 0.015s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e97d290-d836-4970-ad99-95688b52851f]: (4, 'raw') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c5e128-a57c-4bdb-83b9-e1f186973159]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d39d1e7-d08c-42a3-bdba-8543632c2a25 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:53 devstack sudo[114403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d Aug 27 03:57:53 devstack sudo[114403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:53 devstack sudo[114402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD Aug 27 03:57:53 devstack sudo[114402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Flow 'volume_create_manager' (a6163da5-87a6-4580-8f11-aab2b1af2221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b823b2f-17f2-47c5-b5ab-a4335ca532ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:53 devstack sudo[114402]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD" returned: 0 in 0.518s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:53 devstack sudo[114403]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:53 devstack sudo[114399]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b823b2f-17f2-47c5-b5ab-a4335ca532ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-797709864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9feb696-5a56-4fef-b205-d0c7d1398e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8658e7bcb5964a65a4672729d843a24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:53Z,use_quota=True,user_id='d1b1c78558e94e16b33cfaf2594e5ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea71c45-fca0-4c58-bfce-cc57b45626c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea71c45-fca0-4c58-bfce-cc57b45626c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd21bc8-47c2-4d31-ab4c-616eb6667e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd21bc8-47c2-4d31-ab4c-616eb6667e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9feb696-5a56-4fef-b205-d0c7d1398e26', 'volume_name': 'volume-e9feb696-5a56-4fef-b205-d0c7d1398e26', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f3f851d-361c-4598-a237-188d8550be70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f3f851d-361c-4598-a237-188d8550be70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ec23ee-c72b-4875-b190-9d16c62f6fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:53 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Volume e9feb696-5a56-4fef-b205-d0c7d1398e26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9feb696-5a56-4fef-b205-d0c7d1398e26', 'volume_size': 1} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-37370a20-1567-48e6-a5cb-efe38f23d097 1073741824" returned: 0 in 0.791s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d39d1e7-d08c-42a3-bdba-8543632c2a25 tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d" returned: 0 in 0.571s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d39d1e7-d08c-42a3-bdba-8543632c2a25 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:53 devstack sudo[114417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d Aug 27 03:57:53 devstack sudo[114417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-37370a20-1567-48e6-a5cb-efe38f23d097 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:53 devstack sudo[114416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD Aug 27 03:57:53 devstack sudo[114416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:53 devstack sudo[114420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-37370a20-1567-48e6-a5cb-efe38f23d097 Aug 27 03:57:53 devstack sudo[114420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:53 devstack sudo[114416]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD" returned: 1 in 0.336s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Temporary image 4b5d3cba-d3c5-44f2-809d-ffec6a931a78 is fetched for user ed3de510a25a4d8ba62bb1900cf65792. {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 27 03:57:53 devstack sudo[114417]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d39d1e7-d08c-42a3-bdba-8543632c2a25 tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-f4d3444f-ec0d-4663-bbc4-5d9d6455071d" returned: 0 in 0.286s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:53 devstack sudo[114420]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1d39d1e7-d08c-42a3-bdba-8543632c2a25 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-quobyte-f4d3444f-ec0d-4663-bbc4-5d9d6455071d" released by "delete_volume" :: held 0.930s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-37370a20-1567-48e6-a5cb-efe38f23d097" returned: 0 in 0.271s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.694s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-76687658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c36439-8a2f-437f-8911-1777f39abc33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307b668446d24188b4f630371588fa06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:52Z,use_quota=True,user_id='a81a46b57dbf4f5ab3f34a30072c8da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Creating volume 65c36439-8a2f-437f-8911-1777f39abc33 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:53 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-65c36439-8a2f-437f-8911-1777f39abc33 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (236333ca-c1d1-4638-8bfc-91ccbcffae01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37370a20-1567-48e6-a5cb-efe38f23d097', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:53 devstack sudo[114427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-65c36439-8a2f-437f-8911-1777f39abc33 1073741824 Aug 27 03:57:53 devstack sudo[114427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917b0c13-19a7-42b7-a3c2-8d329a656244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:53 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Volume volume-37370a20-1567-48e6-a5cb-efe38f23d097 (37370a20-1567-48e6-a5cb-efe38f23d097): created successfully Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917b0c13-19a7-42b7-a3c2-8d329a656244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Flow 'volume_create_manager' (48d76f02-fb72-49b7-963d-2ef3e1d950c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec97b26-3c84-4c59-9e29-173850d7dba8]: (4, 'raw') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:53 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-65675656-bc51-40d7-8972-e6bec231e077 tempest-CreateVolumesFromImageTest-263987185 None] Created volume successfully. Aug 27 03:57:53 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-1d39d1e7-d08c-42a3-bdba-8543632c2a25 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Created reservations ['e9b843ed-71d7-4846-932c-0498554f92a0', '8b8d53d9-7dde-4224-8e4b-a33a1ec3e866', '7a03e46b-092f-442e-8a47-7e4797501056', '0f8f3fb1-f8fb-4d53-a80b-efc69c6dd8c4'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:54 devstack sudo[114429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD Aug 27 03:57:54 devstack sudo[114429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1d39d1e7-d08c-42a3-bdba-8543632c2a25 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1d39d1e7-d08c-42a3-bdba-8543632c2a25 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1d39d1e7-d08c-42a3-bdba-8543632c2a25 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1d39d1e7-d08c-42a3-bdba-8543632c2a25 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1d39d1e7-d08c-42a3-bdba-8543632c2a25 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d39d1e7-d08c-42a3-bdba-8543632c2a25 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:54 devstack sudo[114431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:57:54 devstack sudo[114431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:54 devstack sudo[114429]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:54 devstack sudo[114427]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-65c36439-8a2f-437f-8911-1777f39abc33 1073741824" returned: 0 in 0.471s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:54 devstack sudo[114431]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1d39d1e7-d08c-42a3-bdba-8543632c2a25 tempest-CreateVolumesFromSnapshotTest-1966912875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.286s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-1d39d1e7-d08c-42a3-bdba-8543632c2a25 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-65c36439-8a2f-437f-8911-1777f39abc33 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:54 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-1d39d1e7-d08c-42a3-bdba-8543632c2a25 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Deleted volume successfully. Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1d39d1e7-d08c-42a3-bdba-8543632c2a25 tempest-CreateVolumesFromSnapshotTest-1966912875 None] Lock "cinder-f4d3444f-ec0d-4663-bbc4-5d9d6455071d-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:54 devstack sudo[114441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-65c36439-8a2f-437f-8911-1777f39abc33 Aug 27 03:57:54 devstack sudo[114441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:54 devstack sudo[114439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD Aug 27 03:57:54 devstack sudo[114439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:54 devstack sudo[114441]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-65c36439-8a2f-437f-8911-1777f39abc33" returned: 0 in 0.260s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.233s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-217735279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307b668446d24188b4f630371588fa06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:52Z,use_quota=True,user_id='a81a46b57dbf4f5ab3f34a30072c8da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Creating volume d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:54 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:54 devstack sudo[114439]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD" returned: 1 in 0.360s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:54 devstack sudo[114448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0 1073741824 Aug 27 03:57:54 devstack sudo[114448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a2001e-82ac-4667-9cce-e88b98eb0aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65c36439-8a2f-437f-8911-1777f39abc33', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415be80a-73ea-46c6-9a80-8a8d8ac61ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:54 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Volume volume-65c36439-8a2f-437f-8911-1777f39abc33 (65c36439-8a2f-437f-8911-1777f39abc33): created successfully Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415be80a-73ea-46c6-9a80-8a8d8ac61ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Flow 'volume_create_manager' (3dbff0cb-ede8-431c-95ec-2f33e846fc05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:54 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-7d68161e-02a9-42ac-9c54-58e70cea536f tempest-CreateVolumesFromImageTest-263987185 None] Created volume successfully. Aug 27 03:57:55 devstack sudo[114448]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0 1073741824" returned: 0 in 0.476s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:55 devstack sudo[114454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0 Aug 27 03:57:55 devstack sudo[114454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:55 devstack sudo[114454]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0" returned: 0 in 0.288s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.950s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-797709864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9feb696-5a56-4fef-b205-d0c7d1398e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8658e7bcb5964a65a4672729d843a24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:53Z,use_quota=True,user_id='d1b1c78558e94e16b33cfaf2594e5ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Creating volume e9feb696-5a56-4fef-b205-d0c7d1398e26 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:55 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe102e02-afb6-4e75-87e4-5cf923daa588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:55 devstack sudo[114457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26 1073741824 Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1833f0bb-5a6d-4e21-9426-7fb7de13b735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:55 devstack sudo[114457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:55 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Volume volume-d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0 (d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0): created successfully Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1833f0bb-5a6d-4e21-9426-7fb7de13b735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Flow 'volume_create_manager' (ddb73ea2-136c-4960-b2b7-566f8e8edec9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:55 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-1e580bc9-cd8d-4de5-9ac6-7691515b86fc tempest-CreateVolumesFromImageTest-263987185 None] Created volume successfully. Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c2eb1382-1c93-4529-adee-f1bbb2a8e012 tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "cinder-d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c2eb1382-1c93-4529-adee-f1bbb2a8e012 tempest-CreateVolumesFromImageTest-263987185 None] Lock "cinder-d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c2eb1382-1c93-4529-adee-f1bbb2a8e012 tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "cinder-quobyte-d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c2eb1382-1c93-4529-adee-f1bbb2a8e012 tempest-CreateVolumesFromImageTest-263987185 None] Lock "cinder-quobyte-d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0" acquired by "delete_volume" :: waited 0.021s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bd3d6c-1f63-4413-bcaf-f2c9d9411662]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c2eb1382-1c93-4529-adee-f1bbb2a8e012 tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:56 devstack sudo[114462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0 Aug 27 03:57:56 devstack sudo[114457]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:56 devstack sudo[114462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26 1073741824" returned: 0 in 0.570s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:56 devstack sudo[114465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26 Aug 27 03:57:56 devstack sudo[114465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:56 devstack sudo[114462]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c2eb1382-1c93-4529-adee-f1bbb2a8e012 tempest-CreateVolumesFromImageTest-263987185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0" returned: 0 in 0.444s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c2eb1382-1c93-4529-adee-f1bbb2a8e012 tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:56 devstack sudo[114465]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26" returned: 0 in 0.293s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.738s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d252714e-d0cc-434d-bced-c1782583bb15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='989f60114eab45fbac34dd160a986f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:52Z,use_quota=True,user_id='ed3de510a25a4d8ba62bb1900cf65792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Creating volume d252714e-d0cc-434d-bced-c1782583bb15 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:56 devstack sudo[114471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0 Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:56 devstack sudo[114471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:57:56 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d252714e-d0cc-434d-bced-c1782583bb15 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ec23ee-c72b-4875-b190-9d16c62f6fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9feb696-5a56-4fef-b205-d0c7d1398e26', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:56 devstack sudo[114473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d252714e-d0cc-434d-bced-c1782583bb15 1073741824 Aug 27 03:57:56 devstack sudo[114473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5533c52-1ca1-4fdb-95e6-c66e1ef6795d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:56 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Volume volume-e9feb696-5a56-4fef-b205-d0c7d1398e26 (e9feb696-5a56-4fef-b205-d0c7d1398e26): created successfully Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5533c52-1ca1-4fdb-95e6-c66e1ef6795d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Flow 'volume_create_manager' (a6163da5-87a6-4580-8f11-aab2b1af2221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:56 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-bccaf41a-518e-4721-9b77-51c9092f3c53 tempest-ProjectMemberTests-1426758417 None] Created volume successfully. Aug 27 03:57:56 devstack sudo[114471]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c2eb1382-1c93-4529-adee-f1bbb2a8e012 tempest-CreateVolumesFromImageTest-263987185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0" returned: 0 in 0.302s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c2eb1382-1c93-4529-adee-f1bbb2a8e012 tempest-CreateVolumesFromImageTest-263987185 None] Lock "cinder-quobyte-d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0" released by "delete_volume" :: held 0.793s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-c2eb1382-1c93-4529-adee-f1bbb2a8e012 tempest-CreateVolumesFromImageTest-263987185 None] Created reservations ['b3a55b06-977f-483d-81e0-19f2d3bcbb2e', '356934c5-f830-4e53-97e9-f54e5bee97ec', 'c2c3d1be-155e-4089-8bbb-e42fd44673c3', 'c1f098aa-328a-4b88-bbf3-62e3d736b895'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c2eb1382-1c93-4529-adee-f1bbb2a8e012 tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c2eb1382-1c93-4529-adee-f1bbb2a8e012 tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c2eb1382-1c93-4529-adee-f1bbb2a8e012 tempest-CreateVolumesFromImageTest-263987185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c2eb1382-1c93-4529-adee-f1bbb2a8e012 tempest-CreateVolumesFromImageTest-263987185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c2eb1382-1c93-4529-adee-f1bbb2a8e012 tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c2eb1382-1c93-4529-adee-f1bbb2a8e012 tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:56 devstack sudo[114480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:57:56 devstack sudo[114480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:56 devstack sudo[114473]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d252714e-d0cc-434d-bced-c1782583bb15 1073741824" returned: 0 in 0.516s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d252714e-d0cc-434d-bced-c1782583bb15 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:56 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4cc9deda-4961-42bd-a90c-2a895a41c132 tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "cinder-65c36439-8a2f-437f-8911-1777f39abc33-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:56 devstack sudo[114482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d252714e-d0cc-434d-bced-c1782583bb15 Aug 27 03:57:56 devstack sudo[114482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4cc9deda-4961-42bd-a90c-2a895a41c132 tempest-CreateVolumesFromImageTest-263987185 None] Lock "cinder-65c36439-8a2f-437f-8911-1777f39abc33-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4cc9deda-4961-42bd-a90c-2a895a41c132 tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "cinder-quobyte-65c36439-8a2f-437f-8911-1777f39abc33" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4cc9deda-4961-42bd-a90c-2a895a41c132 tempest-CreateVolumesFromImageTest-263987185 None] Lock "cinder-quobyte-65c36439-8a2f-437f-8911-1777f39abc33" acquired by "delete_volume" :: waited 0.021s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ef4dc9-8050-4469-b939-a25b0bf78f32]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4cc9deda-4961-42bd-a90c-2a895a41c132 tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-65c36439-8a2f-437f-8911-1777f39abc33 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:57 devstack sudo[114480]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c2eb1382-1c93-4529-adee-f1bbb2a8e012 tempest-CreateVolumesFromImageTest-263987185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.385s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-c2eb1382-1c93-4529-adee-f1bbb2a8e012 tempest-CreateVolumesFromImageTest-263987185 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:57:57 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-c2eb1382-1c93-4529-adee-f1bbb2a8e012 tempest-CreateVolumesFromImageTest-263987185 None] Deleted volume successfully. Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c2eb1382-1c93-4529-adee-f1bbb2a8e012 tempest-CreateVolumesFromImageTest-263987185 None] Lock "cinder-d78546ce-3ac2-4a9e-be5b-2ab26b6d19a0-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:57 devstack sudo[114484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-65c36439-8a2f-437f-8911-1777f39abc33 Aug 27 03:57:57 devstack sudo[114484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:57 devstack sudo[114482]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d252714e-d0cc-434d-bced-c1782583bb15" returned: 0 in 0.316s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Attempting download of 4b5d3cba-d3c5-44f2-809d-ffec6a931a78 ((None, [{'url': 'file:///opt/stack/data/glance/images/4b5d3cba-d3c5-44f2-809d-ffec6a931a78', 'metadata': {}}])) to volume d252714e-d0cc-434d-bced-c1782583bb15. {{(pid=94328) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[6304debb-32e6-44f0-8e74-26f5cb2e4500]: (4, 'raw') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_zxe_rlok {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:57 devstack sudo[114488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_zxe_rlok Aug 27 03:57:57 devstack sudo[114488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:57 devstack sudo[114484]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4cc9deda-4961-42bd-a90c-2a895a41c132 tempest-CreateVolumesFromImageTest-263987185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-65c36439-8a2f-437f-8911-1777f39abc33" returned: 0 in 0.440s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4cc9deda-4961-42bd-a90c-2a895a41c132 tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-65c36439-8a2f-437f-8911-1777f39abc33 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:57 devstack sudo[114494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-65c36439-8a2f-437f-8911-1777f39abc33 Aug 27 03:57:57 devstack sudo[114494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8c09428f-9057-4179-baa9-c35acb360e5b tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8c09428f-9057-4179-baa9-c35acb360e5b tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-8c09428f-9057-4179-baa9-c35acb360e5b tempest-ProjectMemberTests-1426758417 None] Creating offline snapshot 69067e4e-abeb-468e-add2-024bc2c36ce3 of volume e9feb696-5a56-4fef-b205-d0c7d1398e26 {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[36230069-0e90-4533-97c3-ac2283567e32]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8c09428f-9057-4179-baa9-c35acb360e5b tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:57 devstack sudo[114488]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_zxe_rlok" returned: 0 in 0.437s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_zxe_rlok {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:57 devstack sudo[114494]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4cc9deda-4961-42bd-a90c-2a895a41c132 tempest-CreateVolumesFromImageTest-263987185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-65c36439-8a2f-437f-8911-1777f39abc33" returned: 0 in 0.337s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:57 devstack sudo[114498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26 Aug 27 03:57:57 devstack sudo[114498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4cc9deda-4961-42bd-a90c-2a895a41c132 tempest-CreateVolumesFromImageTest-263987185 None] Lock "cinder-quobyte-65c36439-8a2f-437f-8911-1777f39abc33" released by "delete_volume" :: held 0.839s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:57 devstack sudo[114499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_zxe_rlok Aug 27 03:57:57 devstack sudo[114499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:57 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-4cc9deda-4961-42bd-a90c-2a895a41c132 tempest-CreateVolumesFromImageTest-263987185 None] Created reservations ['0671006c-9ff6-461b-8b9d-a85320445e92', '030cd4d9-1956-4b22-b283-2d27dedbd838', '9aa4258c-2ca5-4384-9af4-a8259bc61a56', 'f630e154-2a16-49b8-be22-9eb5ac5fe5d6'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4cc9deda-4961-42bd-a90c-2a895a41c132 tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4cc9deda-4961-42bd-a90c-2a895a41c132 tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4cc9deda-4961-42bd-a90c-2a895a41c132 tempest-CreateVolumesFromImageTest-263987185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4cc9deda-4961-42bd-a90c-2a895a41c132 tempest-CreateVolumesFromImageTest-263987185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4cc9deda-4961-42bd-a90c-2a895a41c132 tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4cc9deda-4961-42bd-a90c-2a895a41c132 tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:58 devstack sudo[114503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:57:58 devstack sudo[114503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-627bd67d-b116-4e34-933a-c98ffed0ed96 tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "cinder-37370a20-1567-48e6-a5cb-efe38f23d097-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:58 devstack sudo[114499]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_zxe_rlok" returned: 1 in 0.487s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_zxe_rlok' failed. Not Retrying. {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-627bd67d-b116-4e34-933a-c98ffed0ed96 tempest-CreateVolumesFromImageTest-263987185 None] Lock "cinder-37370a20-1567-48e6-a5cb-efe38f23d097-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6f65ae-f183-4e30-95c8-741526017bc7]: (4, 'raw') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:58 devstack sudo[114498]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8c09428f-9057-4179-baa9-c35acb360e5b tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26" returned: 0 in 0.582s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8c09428f-9057-4179-baa9-c35acb360e5b tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.69067e4e-abeb-468e-add2-024bc2c36ce3 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:58 devstack sudo[114511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.69067e4e-abeb-468e-add2-024bc2c36ce3 1G Aug 27 03:57:58 devstack sudo[114511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-627bd67d-b116-4e34-933a-c98ffed0ed96 tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "cinder-quobyte-37370a20-1567-48e6-a5cb-efe38f23d097" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-627bd67d-b116-4e34-933a-c98ffed0ed96 tempest-CreateVolumesFromImageTest-263987185 None] Lock "cinder-quobyte-37370a20-1567-48e6-a5cb-efe38f23d097" acquired by "delete_volume" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd53558-e062-4fac-9948-ead9ca7619a8]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-627bd67d-b116-4e34-933a-c98ffed0ed96 tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-37370a20-1567-48e6-a5cb-efe38f23d097 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:58 devstack sudo[114503]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:58 devstack sudo[114510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD Aug 27 03:57:58 devstack sudo[114510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4cc9deda-4961-42bd-a90c-2a895a41c132 tempest-CreateVolumesFromImageTest-263987185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.387s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4cc9deda-4961-42bd-a90c-2a895a41c132 tempest-CreateVolumesFromImageTest-263987185 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:57:58 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-4cc9deda-4961-42bd-a90c-2a895a41c132 tempest-CreateVolumesFromImageTest-263987185 None] Deleted volume successfully. Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4cc9deda-4961-42bd-a90c-2a895a41c132 tempest-CreateVolumesFromImageTest-263987185 None] Lock "cinder-65c36439-8a2f-437f-8911-1777f39abc33-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:58 devstack sudo[114514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-37370a20-1567-48e6-a5cb-efe38f23d097 Aug 27 03:57:58 devstack sudo[114514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:58 devstack sudo[114510]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:58 devstack sudo[114522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD Aug 27 03:57:58 devstack sudo[114522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:58 devstack sudo[114511]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8c09428f-9057-4179-baa9-c35acb360e5b tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.69067e4e-abeb-468e-add2-024bc2c36ce3 1G" returned: 0 in 0.525s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8c09428f-9057-4179-baa9-c35acb360e5b tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9feb696-5a56-4fef-b205-d0c7d1398e26 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.69067e4e-abeb-468e-add2-024bc2c36ce3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:58 devstack sudo[114514]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-627bd67d-b116-4e34-933a-c98ffed0ed96 tempest-CreateVolumesFromImageTest-263987185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-37370a20-1567-48e6-a5cb-efe38f23d097" returned: 0 in 0.462s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-627bd67d-b116-4e34-933a-c98ffed0ed96 tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-37370a20-1567-48e6-a5cb-efe38f23d097 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:58 devstack sudo[114529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9feb696-5a56-4fef-b205-d0c7d1398e26 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.69067e4e-abeb-468e-add2-024bc2c36ce3 Aug 27 03:57:58 devstack sudo[114529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:58 devstack sudo[114531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-37370a20-1567-48e6-a5cb-efe38f23d097 Aug 27 03:57:58 devstack sudo[114531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:59 devstack sudo[114522]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD" returned: 1 in 0.407s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] 4b5d3cba-d3c5-44f2-809d-ffec6a931a78 was raw, converting to qcow2 {{(pid=94328) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d252714e-d0cc-434d-bced-c1782583bb15 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:59 devstack sudo[114538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d252714e-d0cc-434d-bced-c1782583bb15 Aug 27 03:57:59 devstack sudo[114538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:59 devstack sudo[114529]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8c09428f-9057-4179-baa9-c35acb360e5b tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9feb696-5a56-4fef-b205-d0c7d1398e26 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.69067e4e-abeb-468e-add2-024bc2c36ce3" returned: 0 in 0.394s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:59 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-8c09428f-9057-4179-baa9-c35acb360e5b tempest-ProjectMemberTests-1426758417 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.69067e4e-abeb-468e-add2-024bc2c36ce3 is being set with open permissions: ugo+rw Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8c09428f-9057-4179-baa9-c35acb360e5b tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.69067e4e-abeb-468e-add2-024bc2c36ce3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:59 devstack sudo[114531]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-627bd67d-b116-4e34-933a-c98ffed0ed96 tempest-CreateVolumesFromImageTest-263987185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-37370a20-1567-48e6-a5cb-efe38f23d097" returned: 0 in 0.379s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-627bd67d-b116-4e34-933a-c98ffed0ed96 tempest-CreateVolumesFromImageTest-263987185 None] Lock "cinder-quobyte-37370a20-1567-48e6-a5cb-efe38f23d097" released by "delete_volume" :: held 0.897s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:59 devstack sudo[114542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.69067e4e-abeb-468e-add2-024bc2c36ce3 Aug 27 03:57:59 devstack sudo[114542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-627bd67d-b116-4e34-933a-c98ffed0ed96 tempest-CreateVolumesFromImageTest-263987185 None] Created reservations ['8d95fdc7-1360-442d-8bd0-6a12e9d75f50', 'c23f59bb-3ae1-40fd-96b9-476cb7a764af', 'ed342ce3-cb6f-4dbf-a419-fda9c5939a07', '4994923e-3ea0-4706-983d-01a4092b8004'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Flow 'volume_create_manager' (3230a3ba-c061-4736-a9aa-d1b03553e052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810984e0-3c65-4bab-8465-317ca63f70ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810984e0-3c65-4bab-8465-317ca63f70ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-705260528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c91680c73ffe4d6e9be91c4d3a789e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:59Z,use_quota=True,user_id='5ebe86d5bb784b1ead724efed91e0b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a26093f3-37ff-4fd4-b8f4-3d4c225eb1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a26093f3-37ff-4fd4-b8f4-3d4c225eb1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d2fcc7-a5a1-451d-938f-11e7caac6124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d2fcc7-a5a1-451d-938f-11e7caac6124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25', 'volume_name': 'volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ba9ced-27ac-4355-89c5-685405cae537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ba9ced-27ac-4355-89c5-685405cae537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a056774d-30f1-4565-bf6d-6d0452be7f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:57:59 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Volume 5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25', 'volume_size': 1} Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-627bd67d-b116-4e34-933a-c98ffed0ed96 tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-627bd67d-b116-4e34-933a-c98ffed0ed96 tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-627bd67d-b116-4e34-933a-c98ffed0ed96 tempest-CreateVolumesFromImageTest-263987185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-627bd67d-b116-4e34-933a-c98ffed0ed96 tempest-CreateVolumesFromImageTest-263987185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-627bd67d-b116-4e34-933a-c98ffed0ed96 tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-627bd67d-b116-4e34-933a-c98ffed0ed96 tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:59 devstack sudo[114542]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8c09428f-9057-4179-baa9-c35acb360e5b tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.69067e4e-abeb-468e-add2-024bc2c36ce3" returned: 0 in 0.360s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:59 devstack sudo[114548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:57:59 devstack sudo[114548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8c09428f-9057-4179-baa9-c35acb360e5b tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:59 devstack sudo[114550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.info Aug 27 03:57:59 devstack sudo[114550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:59 devstack sudo[114538]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d252714e-d0cc-434d-bced-c1782583bb15" returned: 0 in 0.543s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4b5d3cba-d3c5-44f2-809d-ffec6a931a78_glk0g5kkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d252714e-d0cc-434d-bced-c1782583bb15 {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:57:59 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Converted 0.00 MB image at 0.00 MB/s Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d252714e-d0cc-434d-bced-c1782583bb15 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:59 devstack sudo[114552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d252714e-d0cc-434d-bced-c1782583bb15 1G Aug 27 03:57:59 devstack sudo[114552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:57:59 devstack sudo[114548]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-627bd67d-b116-4e34-933a-c98ffed0ed96 tempest-CreateVolumesFromImageTest-263987185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.283s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-627bd67d-b116-4e34-933a-c98ffed0ed96 tempest-CreateVolumesFromImageTest-263987185 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:57:59 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-627bd67d-b116-4e34-933a-c98ffed0ed96 tempest-CreateVolumesFromImageTest-263987185 None] Deleted volume successfully. Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-627bd67d-b116-4e34-933a-c98ffed0ed96 tempest-CreateVolumesFromImageTest-263987185 None] Lock "cinder-37370a20-1567-48e6-a5cb-efe38f23d097-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:57:59 devstack sudo[114550]: pam_unix(sudo:session): session closed for user root Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8c09428f-9057-4179-baa9-c35acb360e5b tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.info" returned: 0 in 0.270s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:57:59 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-8c09428f-9057-4179-baa9-c35acb360e5b tempest-ProjectMemberTests-1426758417 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.info is being set with open permissions: ugo+rw Aug 27 03:57:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8c09428f-9057-4179-baa9-c35acb360e5b tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:57:59 devstack sudo[114558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.info Aug 27 03:57:59 devstack sudo[114558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:00 devstack sudo[114552]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d252714e-d0cc-434d-bced-c1782583bb15 1G" returned: 0 in 0.330s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Downloaded image 4b5d3cba-d3c5-44f2-809d-ffec6a931a78 ((None, [{'url': 'file:///opt/stack/data/glance/images/4b5d3cba-d3c5-44f2-809d-ffec6a931a78', 'metadata': {}}])) to volume d252714e-d0cc-434d-bced-c1782583bb15 successfully. {{(pid=94328) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Temporary image 4b5d3cba-d3c5-44f2-809d-ffec6a931a78 for user ed3de510a25a4d8ba62bb1900cf65792 is deleted. {{(pid=94328) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.volume.volume_utils [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Marking volume d252714e-d0cc-434d-bced-c1782583bb15 as bootable. {{(pid=94328) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Copying metadata from image 4b5d3cba-d3c5-44f2-809d-ffec6a931a78 to d252714e-d0cc-434d-bced-c1782583bb15. {{(pid=94328) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Creating volume glance metadata for volume d252714e-d0cc-434d-bced-c1782583bb15 backed by image 4b5d3cba-d3c5-44f2-809d-ffec6a931a78 with: {'image_id': '4b5d3cba-d3c5-44f2-809d-ffec6a931a78', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c68e25d29a1bba5343d5548df367802c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94328) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8af78ec-2b72-42c4-8293-04d2bdb7e59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d252714e-d0cc-434d-bced-c1782583bb15', 'volume_size': 1, 'image_id': '4b5d3cba-d3c5-44f2-809d-ffec6a931a78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b5d3cba-d3c5-44f2-809d-ffec6a931a78', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c68e25d29a1bba5343d5548df367802c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '989f60114eab45fbac34dd160a986f48', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2cd9af5f95f84507b4e5f51ec0575d97944233c20c16ecb2136f02b05a1709cfd3a5bbb94ed389378286020a610161019bb1892d79f8f692e511f26c6d553a0d', 'id': '4b5d3cba-d3c5-44f2-809d-ffec6a931a78', 'created_at': datetime.datetime(2026, 8, 27, 1, 57, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 27, 1, 57, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b5d3cba-d3c5-44f2-809d-ffec6a931a78/file', 'properties': {}}, 'image_service': }' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2f511e-9d4e-43b8-95ad-7668ff9dbd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:00 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Volume volume-d252714e-d0cc-434d-bced-c1782583bb15 (d252714e-d0cc-434d-bced-c1782583bb15): created successfully Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2f511e-9d4e-43b8-95ad-7668ff9dbd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:00 devstack sudo[114558]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Flow 'volume_create_manager' (2646f47b-7289-4cc2-b08b-c4b0b43aa31b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8c09428f-9057-4179-baa9-c35acb360e5b tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.info" returned: 0 in 0.263s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8c09428f-9057-4179-baa9-c35acb360e5b tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.496s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.660s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-705260528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c91680c73ffe4d6e9be91c4d3a789e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:57:59Z,use_quota=True,user_id='5ebe86d5bb784b1ead724efed91e0b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Creating volume 5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:58:00 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:00 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-906ef2bf-644f-4b84-a6a7-1fe1eb381cf8 tempest-VolumeImageDependencyTests-1992668383 None] Created volume successfully. Aug 27 03:58:00 devstack sudo[114562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25 1073741824 Aug 27 03:58:00 devstack sudo[114562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:00 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-8c09428f-9057-4179-baa9-c35acb360e5b tempest-ProjectMemberTests-1426758417 None] Create snapshot completed successfully Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d35a08c2-aa3d-427b-bdf7-8eec63293931 tempest-VolumeImageDependencyTests-1992668383 None] Acquiring lock "cinder-d252714e-d0cc-434d-bced-c1782583bb15-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d35a08c2-aa3d-427b-bdf7-8eec63293931 tempest-VolumeImageDependencyTests-1992668383 None] Lock "cinder-d252714e-d0cc-434d-bced-c1782583bb15-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ffa44e21-7ab5-40be-bf9f-5603a72f49b9 tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "cinder-29d6af11-c9e4-4364-a2f2-7d1541be73c2-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d35a08c2-aa3d-427b-bdf7-8eec63293931 tempest-VolumeImageDependencyTests-1992668383 None] Acquiring lock "cinder-quobyte-d252714e-d0cc-434d-bced-c1782583bb15" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ffa44e21-7ab5-40be-bf9f-5603a72f49b9 tempest-CreateVolumesFromImageTest-263987185 None] Lock "cinder-29d6af11-c9e4-4364-a2f2-7d1541be73c2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d35a08c2-aa3d-427b-bdf7-8eec63293931 tempest-VolumeImageDependencyTests-1992668383 None] Lock "cinder-quobyte-d252714e-d0cc-434d-bced-c1782583bb15" acquired by "delete_volume" :: waited 0.032s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82f2956-643c-4d6e-919b-a0dbd95e3483]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d35a08c2-aa3d-427b-bdf7-8eec63293931 tempest-VolumeImageDependencyTests-1992668383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d252714e-d0cc-434d-bced-c1782583bb15 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ffa44e21-7ab5-40be-bf9f-5603a72f49b9 tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "cinder-quobyte-29d6af11-c9e4-4364-a2f2-7d1541be73c2" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ffa44e21-7ab5-40be-bf9f-5603a72f49b9 tempest-CreateVolumesFromImageTest-263987185 None] Lock "cinder-quobyte-29d6af11-c9e4-4364-a2f2-7d1541be73c2" acquired by "delete_volume" :: waited 0.019s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[095e2d07-0707-4886-9aa8-265958359a88]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ffa44e21-7ab5-40be-bf9f-5603a72f49b9 tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-29d6af11-c9e4-4364-a2f2-7d1541be73c2 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:00 devstack sudo[114562]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25 1073741824" returned: 0 in 0.537s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:00 devstack sudo[114569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d252714e-d0cc-434d-bced-c1782583bb15 Aug 27 03:58:00 devstack sudo[114569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:00 devstack sudo[114572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25 Aug 27 03:58:00 devstack sudo[114572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:00 devstack sudo[114570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-29d6af11-c9e4-4364-a2f2-7d1541be73c2 Aug 27 03:58:00 devstack sudo[114570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9a8b505e-54a5-43df-9204-8c984a02a0bf tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-69067e4e-abeb-468e-add2-024bc2c36ce3-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9a8b505e-54a5-43df-9204-8c984a02a0bf tempest-ProjectMemberTests-1426758417 None] Lock "cinder-69067e4e-abeb-468e-add2-024bc2c36ce3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9a8b505e-54a5-43df-9204-8c984a02a0bf tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-e9feb696-5a56-4fef-b205-d0c7d1398e26" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9a8b505e-54a5-43df-9204-8c984a02a0bf tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-e9feb696-5a56-4fef-b205-d0c7d1398e26" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9a8b505e-54a5-43df-9204-8c984a02a0bf tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-69067e4e-abeb-468e-add2-024bc2c36ce3" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9a8b505e-54a5-43df-9204-8c984a02a0bf tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-69067e4e-abeb-468e-add2-024bc2c36ce3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-9a8b505e-54a5-43df-9204-8c984a02a0bf tempest-ProjectMemberTests-1426758417 None] Deleting offline snapshot 69067e4e-abeb-468e-add2-024bc2c36ce3 of volume e9feb696-5a56-4fef-b205-d0c7d1398e26 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-9a8b505e-54a5-43df-9204-8c984a02a0bf tempest-ProjectMemberTests-1426758417 None] snapshot_file for this snap is: volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.69067e4e-abeb-468e-add2-024bc2c36ce3 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b5fe81-9dc1-47e1-aa3c-d6b3bfa78a46]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9a8b505e-54a5-43df-9204-8c984a02a0bf tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.69067e4e-abeb-468e-add2-024bc2c36ce3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:01 devstack sudo[114572]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25" returned: 0 in 0.291s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a056774d-30f1-4565-bf6d-6d0452be7f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:01 devstack sudo[114569]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9471e6c1-f780-40b9-b3ce-e9688c94be9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d35a08c2-aa3d-427b-bdf7-8eec63293931 tempest-VolumeImageDependencyTests-1992668383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d252714e-d0cc-434d-bced-c1782583bb15" returned: 0 in 0.479s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d35a08c2-aa3d-427b-bdf7-8eec63293931 tempest-VolumeImageDependencyTests-1992668383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d252714e-d0cc-434d-bced-c1782583bb15 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:01 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Volume volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25 (5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25): created successfully Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9471e6c1-f780-40b9-b3ce-e9688c94be9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:01 devstack sudo[114583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d252714e-d0cc-434d-bced-c1782583bb15 Aug 27 03:58:01 devstack sudo[114583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Flow 'volume_create_manager' (3230a3ba-c061-4736-a9aa-d1b03553e052) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:01 devstack sudo[114579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.69067e4e-abeb-468e-add2-024bc2c36ce3 Aug 27 03:58:01 devstack sudo[114579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:01 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-ca2a4306-1e4e-4f5c-8bf0-a956fd9fd26d tempest-ProjectReaderTests-806833313 None] Created volume successfully. Aug 27 03:58:01 devstack sudo[114570]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ffa44e21-7ab5-40be-bf9f-5603a72f49b9 tempest-CreateVolumesFromImageTest-263987185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-29d6af11-c9e4-4364-a2f2-7d1541be73c2" returned: 0 in 0.473s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ffa44e21-7ab5-40be-bf9f-5603a72f49b9 tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-29d6af11-c9e4-4364-a2f2-7d1541be73c2 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:01 devstack sudo[114586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-29d6af11-c9e4-4364-a2f2-7d1541be73c2 Aug 27 03:58:01 devstack sudo[114586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:01 devstack sudo[114583]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d35a08c2-aa3d-427b-bdf7-8eec63293931 tempest-VolumeImageDependencyTests-1992668383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d252714e-d0cc-434d-bced-c1782583bb15" returned: 0 in 0.306s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d35a08c2-aa3d-427b-bdf7-8eec63293931 tempest-VolumeImageDependencyTests-1992668383 None] Lock "cinder-quobyte-d252714e-d0cc-434d-bced-c1782583bb15" released by "delete_volume" :: held 0.848s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:01 devstack sudo[114579]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9a8b505e-54a5-43df-9204-8c984a02a0bf tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.69067e4e-abeb-468e-add2-024bc2c36ce3" returned: 0 in 0.427s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-9a8b505e-54a5-43df-9204-8c984a02a0bf tempest-ProjectMemberTests-1426758417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9feb696-5a56-4fef-b205-d0c7d1398e26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:58:01 devstack sudo[114586]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ffa44e21-7ab5-40be-bf9f-5603a72f49b9 tempest-CreateVolumesFromImageTest-263987185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-29d6af11-c9e4-4364-a2f2-7d1541be73c2" returned: 0 in 0.307s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae930bc-2fb0-4871-83c5-17a2ed4c4f0c]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9a8b505e-54a5-43df-9204-8c984a02a0bf tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ffa44e21-7ab5-40be-bf9f-5603a72f49b9 tempest-CreateVolumesFromImageTest-263987185 None] Lock "cinder-quobyte-29d6af11-c9e4-4364-a2f2-7d1541be73c2" released by "delete_volume" :: held 0.845s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-d35a08c2-aa3d-427b-bdf7-8eec63293931 tempest-VolumeImageDependencyTests-1992668383 None] Created reservations ['e4ff8edf-aa85-4ab5-b815-abe2b886f9a4', 'a66c94fb-0f48-43cd-8993-84bbfd269cfc', 'ff27f477-dce2-4ede-876b-2a2a2452822a', '08ae3fa7-404d-4e90-bda0-0b7ef70075d7'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:01 devstack sudo[114594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26 Aug 27 03:58:01 devstack sudo[114594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-ffa44e21-7ab5-40be-bf9f-5603a72f49b9 tempest-CreateVolumesFromImageTest-263987185 None] Created reservations ['94c949db-1507-44e6-840b-1b42b086c435', '30835b8f-7d38-4c3f-8d90-abd7a254957b', 'dda97069-2c06-4761-b1bd-856c6628542b', '5487c55d-2f61-412a-80e5-d29bf0ea70df'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-88db5e8a-6489-40eb-a6f8-bcc3ff18ec96 tempest-ProjectReaderTests-806833313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-88db5e8a-6489-40eb-a6f8-bcc3ff18ec96 tempest-ProjectReaderTests-806833313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d35a08c2-aa3d-427b-bdf7-8eec63293931 tempest-VolumeImageDependencyTests-1992668383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d35a08c2-aa3d-427b-bdf7-8eec63293931 tempest-VolumeImageDependencyTests-1992668383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d35a08c2-aa3d-427b-bdf7-8eec63293931 tempest-VolumeImageDependencyTests-1992668383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d35a08c2-aa3d-427b-bdf7-8eec63293931 tempest-VolumeImageDependencyTests-1992668383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d35a08c2-aa3d-427b-bdf7-8eec63293931 tempest-VolumeImageDependencyTests-1992668383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d35a08c2-aa3d-427b-bdf7-8eec63293931 tempest-VolumeImageDependencyTests-1992668383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-88db5e8a-6489-40eb-a6f8-bcc3ff18ec96 tempest-ProjectReaderTests-806833313 None] Creating offline snapshot aa041e5a-a71c-4548-9b03-0f832c80e248 of volume 5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25 {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:58:01 devstack sudo[114596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:58:01 devstack sudo[114596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ffa44e21-7ab5-40be-bf9f-5603a72f49b9 tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ffa44e21-7ab5-40be-bf9f-5603a72f49b9 tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ffa44e21-7ab5-40be-bf9f-5603a72f49b9 tempest-CreateVolumesFromImageTest-263987185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ffa44e21-7ab5-40be-bf9f-5603a72f49b9 tempest-CreateVolumesFromImageTest-263987185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ffa44e21-7ab5-40be-bf9f-5603a72f49b9 tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ffa44e21-7ab5-40be-bf9f-5603a72f49b9 tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d34671-91a1-47de-85f7-49b2837703d1]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-88db5e8a-6489-40eb-a6f8-bcc3ff18ec96 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:01 devstack sudo[114601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:58:01 devstack sudo[114601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:01 devstack sudo[114594]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9a8b505e-54a5-43df-9204-8c984a02a0bf tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26" returned: 0 in 0.481s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9a8b505e-54a5-43df-9204-8c984a02a0bf tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.69067e4e-abeb-468e-add2-024bc2c36ce3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:02 devstack sudo[114605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.69067e4e-abeb-468e-add2-024bc2c36ce3 Aug 27 03:58:02 devstack sudo[114605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:02 devstack sudo[114602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25 Aug 27 03:58:02 devstack sudo[114602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:02 devstack sudo[114596]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d35a08c2-aa3d-427b-bdf7-8eec63293931 tempest-VolumeImageDependencyTests-1992668383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.340s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:02 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-d35a08c2-aa3d-427b-bdf7-8eec63293931 tempest-VolumeImageDependencyTests-1992668383 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:58:02 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d35a08c2-aa3d-427b-bdf7-8eec63293931 tempest-VolumeImageDependencyTests-1992668383 None] Deleted volume successfully. Aug 27 03:58:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d35a08c2-aa3d-427b-bdf7-8eec63293931 tempest-VolumeImageDependencyTests-1992668383 None] Lock "cinder-d252714e-d0cc-434d-bced-c1782583bb15-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:02 devstack sudo[114601]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ffa44e21-7ab5-40be-bf9f-5603a72f49b9 tempest-CreateVolumesFromImageTest-263987185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.398s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:02 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-ffa44e21-7ab5-40be-bf9f-5603a72f49b9 tempest-CreateVolumesFromImageTest-263987185 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:58:02 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-ffa44e21-7ab5-40be-bf9f-5603a72f49b9 tempest-CreateVolumesFromImageTest-263987185 None] Deleted volume successfully. Aug 27 03:58:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ffa44e21-7ab5-40be-bf9f-5603a72f49b9 tempest-CreateVolumesFromImageTest-263987185 None] Lock "cinder-29d6af11-c9e4-4364-a2f2-7d1541be73c2-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:02 devstack sudo[114602]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-88db5e8a-6489-40eb-a6f8-bcc3ff18ec96 tempest-ProjectReaderTests-806833313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25" returned: 0 in 0.471s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-88db5e8a-6489-40eb-a6f8-bcc3ff18ec96 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.aa041e5a-a71c-4548-9b03-0f832c80e248 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:02 devstack sudo[114617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.aa041e5a-a71c-4548-9b03-0f832c80e248 1G Aug 27 03:58:02 devstack sudo[114617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:02 devstack sudo[114605]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9a8b505e-54a5-43df-9204-8c984a02a0bf tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.69067e4e-abeb-468e-add2-024bc2c36ce3" returned: 0 in 0.505s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9a8b505e-54a5-43df-9204-8c984a02a0bf tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.69067e4e-abeb-468e-add2-024bc2c36ce3 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:02 devstack sudo[114619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.69067e4e-abeb-468e-add2-024bc2c36ce3 Aug 27 03:58:02 devstack sudo[114619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:02 devstack sudo[114619]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9a8b505e-54a5-43df-9204-8c984a02a0bf tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26.69067e4e-abeb-468e-add2-024bc2c36ce3" returned: 0 in 0.293s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9a8b505e-54a5-43df-9204-8c984a02a0bf tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-69067e4e-abeb-468e-add2-024bc2c36ce3" released by "_delete_snapshot" :: held 1.846s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9a8b505e-54a5-43df-9204-8c984a02a0bf tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-e9feb696-5a56-4fef-b205-d0c7d1398e26" released by "delete_snapshot" :: held 1.873s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-edec5312-14ec-47bb-a0b9-1c28357c58cf tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "cinder-e26c77ed-b8f9-4984-b735-797e0b49f411-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:02 devstack sudo[114617]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-88db5e8a-6489-40eb-a6f8-bcc3ff18ec96 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.aa041e5a-a71c-4548-9b03-0f832c80e248 1G" returned: 0 in 0.520s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-88db5e8a-6489-40eb-a6f8-bcc3ff18ec96 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.aa041e5a-a71c-4548-9b03-0f832c80e248 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:02 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-9a8b505e-54a5-43df-9204-8c984a02a0bf tempest-ProjectMemberTests-1426758417 None] Created reservations ['c6a7ee33-a621-4531-a6e6-44ef61aaeb92', '3744cf70-bdbb-4b95-bc06-7f8fda85973d', 'acfe89a6-e6bb-46ed-8e09-5865781f8b2f', 'c3c234bc-6e44-484b-811e-4341fac5258c'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-edec5312-14ec-47bb-a0b9-1c28357c58cf tempest-CreateVolumesFromImageTest-263987185 None] Lock "cinder-e26c77ed-b8f9-4984-b735-797e0b49f411-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:02 devstack sudo[114626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.aa041e5a-a71c-4548-9b03-0f832c80e248 Aug 27 03:58:02 devstack sudo[114626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-edec5312-14ec-47bb-a0b9-1c28357c58cf tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "cinder-quobyte-e26c77ed-b8f9-4984-b735-797e0b49f411" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-edec5312-14ec-47bb-a0b9-1c28357c58cf tempest-CreateVolumesFromImageTest-263987185 None] Lock "cinder-quobyte-e26c77ed-b8f9-4984-b735-797e0b49f411" acquired by "delete_volume" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:03 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-9a8b505e-54a5-43df-9204-8c984a02a0bf tempest-ProjectMemberTests-1426758417 None] Delete snapshot completed successfully. Aug 27 03:58:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9a8b505e-54a5-43df-9204-8c984a02a0bf tempest-ProjectMemberTests-1426758417 None] Lock "cinder-69067e4e-abeb-468e-add2-024bc2c36ce3-delete_snapshot" released by "delete_snapshot" :: held 2.115s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:03 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab07d96-4531-445b-90e5-6c360f2d374a]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-edec5312-14ec-47bb-a0b9-1c28357c58cf tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e26c77ed-b8f9-4984-b735-797e0b49f411 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2f67a101-e0a1-4f81-8a6e-f632cf1c45c7 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-e9feb696-5a56-4fef-b205-d0c7d1398e26-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2f67a101-e0a1-4f81-8a6e-f632cf1c45c7 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-e9feb696-5a56-4fef-b205-d0c7d1398e26-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:03 devstack sudo[114628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e26c77ed-b8f9-4984-b735-797e0b49f411 Aug 27 03:58:03 devstack sudo[114628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2f67a101-e0a1-4f81-8a6e-f632cf1c45c7 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-e9feb696-5a56-4fef-b205-d0c7d1398e26" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2f67a101-e0a1-4f81-8a6e-f632cf1c45c7 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-e9feb696-5a56-4fef-b205-d0c7d1398e26" acquired by "delete_volume" :: waited 0.034s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:03 devstack sudo[114626]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-88db5e8a-6489-40eb-a6f8-bcc3ff18ec96 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.aa041e5a-a71c-4548-9b03-0f832c80e248" returned: 0 in 0.462s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:03 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-88db5e8a-6489-40eb-a6f8-bcc3ff18ec96 tempest-ProjectReaderTests-806833313 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.aa041e5a-a71c-4548-9b03-0f832c80e248 is being set with open permissions: ugo+rw Aug 27 03:58:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-88db5e8a-6489-40eb-a6f8-bcc3ff18ec96 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.aa041e5a-a71c-4548-9b03-0f832c80e248 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:03 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bbca41-3d91-40ed-82ce-19ffc4c356f0]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2f67a101-e0a1-4f81-8a6e-f632cf1c45c7 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:03 devstack sudo[114637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.aa041e5a-a71c-4548-9b03-0f832c80e248 Aug 27 03:58:03 devstack sudo[114637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:03 devstack sudo[114638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26 Aug 27 03:58:03 devstack sudo[114638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:03 devstack sudo[114628]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-edec5312-14ec-47bb-a0b9-1c28357c58cf tempest-CreateVolumesFromImageTest-263987185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e26c77ed-b8f9-4984-b735-797e0b49f411" returned: 0 in 0.496s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-edec5312-14ec-47bb-a0b9-1c28357c58cf tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e26c77ed-b8f9-4984-b735-797e0b49f411 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:03 devstack sudo[114644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e26c77ed-b8f9-4984-b735-797e0b49f411 Aug 27 03:58:03 devstack sudo[114644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:03 devstack sudo[114637]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-88db5e8a-6489-40eb-a6f8-bcc3ff18ec96 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.aa041e5a-a71c-4548-9b03-0f832c80e248" returned: 0 in 0.320s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-88db5e8a-6489-40eb-a6f8-bcc3ff18ec96 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:03 devstack sudo[114647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.info Aug 27 03:58:03 devstack sudo[114647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:03 devstack sudo[114638]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:03 devstack sudo[114644]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-edec5312-14ec-47bb-a0b9-1c28357c58cf tempest-CreateVolumesFromImageTest-263987185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e26c77ed-b8f9-4984-b735-797e0b49f411" returned: 0 in 0.350s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2f67a101-e0a1-4f81-8a6e-f632cf1c45c7 tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26" returned: 0 in 0.531s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2f67a101-e0a1-4f81-8a6e-f632cf1c45c7 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:03 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-edec5312-14ec-47bb-a0b9-1c28357c58cf tempest-CreateVolumesFromImageTest-263987185 None] Lock "cinder-quobyte-e26c77ed-b8f9-4984-b735-797e0b49f411" released by "delete_volume" :: held 0.914s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:03 devstack sudo[114653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26 Aug 27 03:58:03 devstack sudo[114653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-edec5312-14ec-47bb-a0b9-1c28357c58cf tempest-CreateVolumesFromImageTest-263987185 None] Created reservations ['9b7658a5-ca5f-4f51-be56-2084fdaf4b23', '61ff090b-b721-4939-a061-8c1d5350a630', 'b55196f7-8efd-4f59-a095-a20b08a6dbc1', 'c813f98d-67fc-4fe5-b4b1-799eda5f9e05'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-edec5312-14ec-47bb-a0b9-1c28357c58cf tempest-CreateVolumesFromImageTest-263987185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-edec5312-14ec-47bb-a0b9-1c28357c58cf tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-edec5312-14ec-47bb-a0b9-1c28357c58cf tempest-CreateVolumesFromImageTest-263987185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:04 devstack sudo[114647]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-edec5312-14ec-47bb-a0b9-1c28357c58cf tempest-CreateVolumesFromImageTest-263987185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-edec5312-14ec-47bb-a0b9-1c28357c58cf tempest-CreateVolumesFromImageTest-263987185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-edec5312-14ec-47bb-a0b9-1c28357c58cf tempest-CreateVolumesFromImageTest-263987185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-88db5e8a-6489-40eb-a6f8-bcc3ff18ec96 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.info" returned: 0 in 0.376s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:04 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-88db5e8a-6489-40eb-a6f8-bcc3ff18ec96 tempest-ProjectReaderTests-806833313 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.info is being set with open permissions: ugo+rw Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-88db5e8a-6489-40eb-a6f8-bcc3ff18ec96 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:04 devstack sudo[114656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:58:04 devstack sudo[114656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:04 devstack sudo[114657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.info Aug 27 03:58:04 devstack sudo[114657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:04 devstack sudo[114653]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2f67a101-e0a1-4f81-8a6e-f632cf1c45c7 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e9feb696-5a56-4fef-b205-d0c7d1398e26" returned: 0 in 0.368s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2f67a101-e0a1-4f81-8a6e-f632cf1c45c7 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-e9feb696-5a56-4fef-b205-d0c7d1398e26" released by "delete_volume" :: held 1.009s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-2f67a101-e0a1-4f81-8a6e-f632cf1c45c7 tempest-ProjectMemberTests-1426758417 None] Created reservations ['a340f761-485c-420d-a83b-6df02c25c4d6', '02dafbdf-e5f0-481c-8061-05b0fbf18d68', '7852d38a-fc92-4055-97e5-9ab0615b0929', '75840a87-55cd-48d3-a6c9-651a2c52818b'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:04 devstack sudo[114656]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-edec5312-14ec-47bb-a0b9-1c28357c58cf tempest-CreateVolumesFromImageTest-263987185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.345s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-edec5312-14ec-47bb-a0b9-1c28357c58cf tempest-CreateVolumesFromImageTest-263987185 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:58:04 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-edec5312-14ec-47bb-a0b9-1c28357c58cf tempest-CreateVolumesFromImageTest-263987185 None] Deleted volume successfully. Aug 27 03:58:04 devstack sudo[114657]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-88db5e8a-6489-40eb-a6f8-bcc3ff18ec96 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.info" returned: 0 in 0.371s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-88db5e8a-6489-40eb-a6f8-bcc3ff18ec96 tempest-ProjectReaderTests-806833313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.730s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-edec5312-14ec-47bb-a0b9-1c28357c58cf tempest-CreateVolumesFromImageTest-263987185 None] Lock "cinder-e26c77ed-b8f9-4984-b735-797e0b49f411-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2f67a101-e0a1-4f81-8a6e-f632cf1c45c7 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2f67a101-e0a1-4f81-8a6e-f632cf1c45c7 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2f67a101-e0a1-4f81-8a6e-f632cf1c45c7 tempest-ProjectMemberTests-1426758417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2f67a101-e0a1-4f81-8a6e-f632cf1c45c7 tempest-ProjectMemberTests-1426758417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2f67a101-e0a1-4f81-8a6e-f632cf1c45c7 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2f67a101-e0a1-4f81-8a6e-f632cf1c45c7 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:04 devstack sudo[114663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:58:04 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-88db5e8a-6489-40eb-a6f8-bcc3ff18ec96 tempest-ProjectReaderTests-806833313 None] Create snapshot completed successfully Aug 27 03:58:04 devstack sudo[114663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:04 devstack sudo[114663]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2f67a101-e0a1-4f81-8a6e-f632cf1c45c7 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.276s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-2f67a101-e0a1-4f81-8a6e-f632cf1c45c7 tempest-ProjectMemberTests-1426758417 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:58:04 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-2f67a101-e0a1-4f81-8a6e-f632cf1c45c7 tempest-ProjectMemberTests-1426758417 None] Deleted volume successfully. Aug 27 03:58:04 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2f67a101-e0a1-4f81-8a6e-f632cf1c45c7 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-e9feb696-5a56-4fef-b205-d0c7d1398e26-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-49304152-e633-4feb-93ba-88a4b6417654 tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-aa041e5a-a71c-4548-9b03-0f832c80e248-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-49304152-e633-4feb-93ba-88a4b6417654 tempest-ProjectReaderTests-806833313 None] Lock "cinder-aa041e5a-a71c-4548-9b03-0f832c80e248-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-49304152-e633-4feb-93ba-88a4b6417654 tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-quobyte-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-49304152-e633-4feb-93ba-88a4b6417654 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-49304152-e633-4feb-93ba-88a4b6417654 tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-quobyte-aa041e5a-a71c-4548-9b03-0f832c80e248" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-49304152-e633-4feb-93ba-88a4b6417654 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-aa041e5a-a71c-4548-9b03-0f832c80e248" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-49304152-e633-4feb-93ba-88a4b6417654 tempest-ProjectReaderTests-806833313 None] Deleting offline snapshot aa041e5a-a71c-4548-9b03-0f832c80e248 of volume 5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-49304152-e633-4feb-93ba-88a4b6417654 tempest-ProjectReaderTests-806833313 None] snapshot_file for this snap is: volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.aa041e5a-a71c-4548-9b03-0f832c80e248 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f81de9-5f6d-4ee7-9444-6694e198b0e3]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-49304152-e633-4feb-93ba-88a4b6417654 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.aa041e5a-a71c-4548-9b03-0f832c80e248 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:05 devstack sudo[114666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.aa041e5a-a71c-4548-9b03-0f832c80e248 Aug 27 03:58:05 devstack sudo[114666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:58:05 devstack sudo[114666]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Flow 'volume_create_manager' (e39114e0-cb95-4646-bd4c-8bda16af128b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6daed499-2ca8-4792-8d95-babd537615df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-49304152-e633-4feb-93ba-88a4b6417654 tempest-ProjectReaderTests-806833313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.aa041e5a-a71c-4548-9b03-0f832c80e248" returned: 0 in 0.548s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-49304152-e633-4feb-93ba-88a4b6417654 tempest-ProjectReaderTests-806833313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6daed499-2ca8-4792-8d95-babd537615df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54d0461-ecec-44c0-95f0-6d4949f6f43c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7756ff96f7b94f278c26d8ab194d534c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:06Z,use_quota=True,user_id='598198b5dbb84b6ca87054ea776052dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb461d15-3452-45da-abba-490585362216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb461d15-3452-45da-abba-490585362216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64daa4a7-999e-4732-9b45-b9cabdc8dac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64daa4a7-999e-4732-9b45-b9cabdc8dac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c54d0461-ecec-44c0-95f0-6d4949f6f43c', 'volume_name': 'volume-c54d0461-ecec-44c0-95f0-6d4949f6f43c', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7540fb0-2358-441a-8275-5eb3795102f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7540fb0-2358-441a-8275-5eb3795102f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d1b2d95-81e1-4396-92d2-561cbc35e719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:05 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Volume c54d0461-ecec-44c0-95f0-6d4949f6f43c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c54d0461-ecec-44c0-95f0-6d4949f6f43c', 'volume_size': 1} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54d0461-ecec-44c0-95f0-6d4949f6f43c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7756ff96f7b94f278c26d8ab194d534c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:06Z,use_quota=True,user_id='598198b5dbb84b6ca87054ea776052dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Creating volume c54d0461-ecec-44c0-95f0-6d4949f6f43c {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:58:05 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c54d0461-ecec-44c0-95f0-6d4949f6f43c 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[8177a5a0-6f64-49e9-a681-fadb57747afd]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-49304152-e633-4feb-93ba-88a4b6417654 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:05 devstack sudo[114671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c54d0461-ecec-44c0-95f0-6d4949f6f43c 1073741824 Aug 27 03:58:05 devstack sudo[114671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Flow 'volume_create_manager' (afb32d24-c5f1-4463-803f-d388a4a564e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e212a955-b43d-4103-ae0f-ebcce962885d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e212a955-b43d-4103-ae0f-ebcce962885d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-971982928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596c98ec-6d56-4bbe-97b9-56a58fdbcc28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8658e7bcb5964a65a4672729d843a24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:06Z,use_quota=True,user_id='d1b1c78558e94e16b33cfaf2594e5ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ded0f29-b6b1-4cfa-917b-a04f0902b192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ded0f29-b6b1-4cfa-917b-a04f0902b192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badb5af0-bc12-4601-8b49-02515daec9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badb5af0-bc12-4601-8b49-02515daec9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '596c98ec-6d56-4bbe-97b9-56a58fdbcc28', 'volume_name': 'volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:06 devstack sudo[114672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25 Aug 27 03:58:06 devstack sudo[114672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73057171-376a-425e-932b-ddfd12e9652f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73057171-376a-425e-932b-ddfd12e9652f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9b8f1f-734d-4e7c-a17a-a39ef8b9e872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:06 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Volume 596c98ec-6d56-4bbe-97b9-56a58fdbcc28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28', 'volume_size': 1} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:06 devstack sudo[114672]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-49304152-e633-4feb-93ba-88a4b6417654 tempest-ProjectReaderTests-806833313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25" returned: 0 in 0.447s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-49304152-e633-4feb-93ba-88a4b6417654 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.aa041e5a-a71c-4548-9b03-0f832c80e248 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:06 devstack sudo[114682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.aa041e5a-a71c-4548-9b03-0f832c80e248 Aug 27 03:58:06 devstack sudo[114682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:06 devstack sudo[114671]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c54d0461-ecec-44c0-95f0-6d4949f6f43c 1073741824" returned: 0 in 0.560s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c54d0461-ecec-44c0-95f0-6d4949f6f43c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:06 devstack sudo[114684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c54d0461-ecec-44c0-95f0-6d4949f6f43c Aug 27 03:58:06 devstack sudo[114684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:06 devstack sudo[114682]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-49304152-e633-4feb-93ba-88a4b6417654 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.aa041e5a-a71c-4548-9b03-0f832c80e248" returned: 0 in 0.407s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-49304152-e633-4feb-93ba-88a4b6417654 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.aa041e5a-a71c-4548-9b03-0f832c80e248 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:06 devstack sudo[114684]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:06 devstack sudo[114691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.aa041e5a-a71c-4548-9b03-0f832c80e248 Aug 27 03:58:06 devstack sudo[114691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c54d0461-ecec-44c0-95f0-6d4949f6f43c" returned: 0 in 0.290s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.704s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-971982928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596c98ec-6d56-4bbe-97b9-56a58fdbcc28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8658e7bcb5964a65a4672729d843a24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:06Z,use_quota=True,user_id='d1b1c78558e94e16b33cfaf2594e5ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Creating volume 596c98ec-6d56-4bbe-97b9-56a58fdbcc28 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:58:06 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d1b2d95-81e1-4396-92d2-561cbc35e719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c54d0461-ecec-44c0-95f0-6d4949f6f43c', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:06 devstack sudo[114693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28 1073741824 Aug 27 03:58:06 devstack sudo[114693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70f6eec3-968a-4ac5-93b4-5e3e29b1d5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:06 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Volume volume-c54d0461-ecec-44c0-95f0-6d4949f6f43c (c54d0461-ecec-44c0-95f0-6d4949f6f43c): created successfully Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70f6eec3-968a-4ac5-93b4-5e3e29b1d5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:06 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Flow 'volume_create_manager' (e39114e0-cb95-4646-bd4c-8bda16af128b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:06 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-7b1e2e94-90df-454e-81ff-4ede5a233fb7 tempest-CinderUnicodeTest-1288583701 None] Created volume successfully. Aug 27 03:58:07 devstack sudo[114691]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-49304152-e633-4feb-93ba-88a4b6417654 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25.aa041e5a-a71c-4548-9b03-0f832c80e248" returned: 0 in 0.311s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-49304152-e633-4feb-93ba-88a4b6417654 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-aa041e5a-a71c-4548-9b03-0f832c80e248" released by "_delete_snapshot" :: held 1.916s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-49304152-e633-4feb-93ba-88a4b6417654 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25" released by "delete_snapshot" :: held 1.946s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:07 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-49304152-e633-4feb-93ba-88a4b6417654 tempest-ProjectReaderTests-806833313 None] Created reservations ['0fa0d1bf-423f-41e4-b94b-6618d104533d', '585a6835-8aa8-48a7-989a-448678ea355b', '3e82ad95-35a5-4409-985a-0bb1acbc7ee1', '740ed425-eee6-4ff0-b306-e24da9065601'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:07 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-49304152-e633-4feb-93ba-88a4b6417654 tempest-ProjectReaderTests-806833313 None] Delete snapshot completed successfully. Aug 27 03:58:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-49304152-e633-4feb-93ba-88a4b6417654 tempest-ProjectReaderTests-806833313 None] Lock "cinder-aa041e5a-a71c-4548-9b03-0f832c80e248-delete_snapshot" released by "delete_snapshot" :: held 2.135s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5a6a54dd-9af8-4fd8-9d4b-a2028ac7e625 tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5a6a54dd-9af8-4fd8-9d4b-a2028ac7e625 tempest-ProjectReaderTests-806833313 None] Lock "cinder-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5a6a54dd-9af8-4fd8-9d4b-a2028ac7e625 tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-quobyte-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5a6a54dd-9af8-4fd8-9d4b-a2028ac7e625 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25" acquired by "delete_volume" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:07 devstack sudo[114693]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28 1073741824" returned: 0 in 0.614s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:07 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[045ec1c8-5b5b-4c3c-8c45-851ebe3988fd]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5a6a54dd-9af8-4fd8-9d4b-a2028ac7e625 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:07 devstack sudo[114701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28 Aug 27 03:58:07 devstack sudo[114701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:07 devstack sudo[114700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25 Aug 27 03:58:07 devstack sudo[114700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:07 devstack sudo[114701]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28" returned: 0 in 0.313s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:07 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:58:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9b8f1f-734d-4e7c-a17a-a39ef8b9e872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e58f819b-6d60-4af4-be41-98ee514e2bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:07 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Volume volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28 (596c98ec-6d56-4bbe-97b9-56a58fdbcc28): created successfully Aug 27 03:58:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e58f819b-6d60-4af4-be41-98ee514e2bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:07 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Flow 'volume_create_manager' (afb32d24-c5f1-4463-803f-d388a4a564e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:07 devstack sudo[114700]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5a6a54dd-9af8-4fd8-9d4b-a2028ac7e625 tempest-ProjectReaderTests-806833313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25" returned: 0 in 0.416s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5a6a54dd-9af8-4fd8-9d4b-a2028ac7e625 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:07 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-1598e852-8885-452b-879f-746fb37da385 tempest-ProjectMemberTests-1426758417 None] Created volume successfully. Aug 27 03:58:07 devstack sudo[114708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25 Aug 27 03:58:07 devstack sudo[114708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:08 devstack sudo[114708]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5a6a54dd-9af8-4fd8-9d4b-a2028ac7e625 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25" returned: 0 in 0.295s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5a6a54dd-9af8-4fd8-9d4b-a2028ac7e625 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25" released by "delete_volume" :: held 0.796s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-5a6a54dd-9af8-4fd8-9d4b-a2028ac7e625 tempest-ProjectReaderTests-806833313 None] Created reservations ['d3dc26a6-129b-4f42-af45-e8969a5f3081', 'fc8495b4-677c-43e5-a154-cb1e482b5c6d', '79aa2269-c1dd-4655-8641-aebf10d73c1b', '614b9321-a915-4649-9386-9db95094f1a7'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5a6a54dd-9af8-4fd8-9d4b-a2028ac7e625 tempest-ProjectReaderTests-806833313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5a6a54dd-9af8-4fd8-9d4b-a2028ac7e625 tempest-ProjectReaderTests-806833313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5a6a54dd-9af8-4fd8-9d4b-a2028ac7e625 tempest-ProjectReaderTests-806833313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5a6a54dd-9af8-4fd8-9d4b-a2028ac7e625 tempest-ProjectReaderTests-806833313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5a6a54dd-9af8-4fd8-9d4b-a2028ac7e625 tempest-ProjectReaderTests-806833313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5a6a54dd-9af8-4fd8-9d4b-a2028ac7e625 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:58:08 devstack sudo[114713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:58:08 devstack sudo[114713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Flow 'volume_create_manager' (e39b7793-3acb-4815-b2b0-4f31ade6fe59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d5f201-6e24-4bef-bdc4-b0896bd38aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d5f201-6e24-4bef-bdc4-b0896bd38aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2005335098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2bf5646-4a6b-4e23-97c8-c53855dda2d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7756ff96f7b94f278c26d8ab194d534c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:08Z,use_quota=True,user_id='598198b5dbb84b6ca87054ea776052dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6229b061-309c-4059-a222-64bb89612243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6229b061-309c-4059-a222-64bb89612243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d84841b0-708e-49d6-baf0-6faa8b1f4c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d84841b0-708e-49d6-baf0-6faa8b1f4c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2bf5646-4a6b-4e23-97c8-c53855dda2d9', 'volume_name': 'volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41deb48e-0d7d-4702-b7cf-cc9e15998097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41deb48e-0d7d-4702-b7cf-cc9e15998097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff1b718-5e7b-4517-a796-dbb7f88b5ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:08 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Volume c2bf5646-4a6b-4e23-97c8-c53855dda2d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9', 'volume_size': 1} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2005335098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2bf5646-4a6b-4e23-97c8-c53855dda2d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7756ff96f7b94f278c26d8ab194d534c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:08Z,use_quota=True,user_id='598198b5dbb84b6ca87054ea776052dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Creating volume c2bf5646-4a6b-4e23-97c8-c53855dda2d9 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:58:08 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:58:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:08 devstack sudo[114715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9 1073741824 Aug 27 03:58:08 devstack sudo[114715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:09 devstack sudo[114713]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5a6a54dd-9af8-4fd8-9d4b-a2028ac7e625 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.551s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-5a6a54dd-9af8-4fd8-9d4b-a2028ac7e625 tempest-ProjectReaderTests-806833313 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-32b4f886-0f69-4263-b79f-03c83fe4c087 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:09 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-5a6a54dd-9af8-4fd8-9d4b-a2028ac7e625 tempest-ProjectReaderTests-806833313 None] Deleted volume successfully. Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5a6a54dd-9af8-4fd8-9d4b-a2028ac7e625 tempest-ProjectReaderTests-806833313 None] Lock "cinder-5b1a8bed-a4a2-48f7-ad9f-13ebb3c53b25-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Flow 'volume_create_manager' (0621ecc0-fdef-4f3a-9e78-e5890ffdd75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec7c3626-4219-4f19-9129-03509040bbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec7c3626-4219-4f19-9129-03509040bbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1406105151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0657a07a-074d-41e2-a4a8-50bbe981b77d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='358466edca284540b0feb1aba1d2c1b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:09Z,use_quota=True,user_id='2f8195d32bca46b585a4529fe7fff7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d3177d0-1156-4f41-ad1d-b687140a2961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d3177d0-1156-4f41-ad1d-b687140a2961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7edb53b3-d0e0-4a8e-b0e0-3294b9e3198e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7edb53b3-d0e0-4a8e-b0e0-3294b9e3198e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0657a07a-074d-41e2-a4a8-50bbe981b77d', 'volume_name': 'volume-0657a07a-074d-41e2-a4a8-50bbe981b77d', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6632987a-751f-4411-bf52-e47eb351aa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6632987a-751f-4411-bf52-e47eb351aa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8cc8a6-645c-494f-ac3a-f3de1a1d9270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:09 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Volume 0657a07a-074d-41e2-a4a8-50bbe981b77d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0657a07a-074d-41e2-a4a8-50bbe981b77d', 'volume_size': 1} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:09 devstack sudo[114715]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9 1073741824" returned: 0 in 0.570s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:09 devstack sudo[114722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9 Aug 27 03:58:09 devstack sudo[114722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Flow 'volume_create_manager' (34c2095b-5e20-4e5f-997d-9ef5e3f2c5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87760da1-5c1b-48c1-a078-da5b7a51b615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87760da1-5c1b-48c1-a078-da5b7a51b615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1822227170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a22177-dc0b-44bd-a146-462a69f8a1ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c91680c73ffe4d6e9be91c4d3a789e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:09Z,use_quota=True,user_id='5ebe86d5bb784b1ead724efed91e0b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea09a0d6-4302-4086-9044-523607015694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea09a0d6-4302-4086-9044-523607015694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e963b08-5f76-494b-9a23-4c174ecc47fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e963b08-5f76-494b-9a23-4c174ecc47fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4a22177-dc0b-44bd-a146-462a69f8a1ba', 'volume_name': 'volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f6f975-597f-413e-8e7c-339c13b151a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f6f975-597f-413e-8e7c-339c13b151a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3d23f9-363b-4d64-b74b-929431af8726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:09 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Volume d4a22177-dc0b-44bd-a146-462a69f8a1ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba', 'volume_size': 1} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:09 devstack sudo[114722]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9" returned: 0 in 0.268s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-32b4f886-0f69-4263-b79f-03c83fe4c087 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.511s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff1b718-5e7b-4517-a796-dbb7f88b5ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40fd9c29-5c26-41b5-959b-12ea87991cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-32b4f886-0f69-4263-b79f-03c83fe4c087 tempest-ProjectMemberTests-1426758417 None] Creating offline snapshot 18acc812-dca6-4ac0-9655-6166c06e43d9 of volume 596c98ec-6d56-4bbe-97b9-56a58fdbcc28 {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:58:09 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Volume volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9 (c2bf5646-4a6b-4e23-97c8-c53855dda2d9): created successfully Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40fd9c29-5c26-41b5-959b-12ea87991cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Flow 'volume_create_manager' (e39b7793-3acb-4815-b2b0-4f31ade6fe59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd93af1-85e6-4fd7-be58-95df8e1216c3]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32b4f886-0f69-4263-b79f-03c83fe4c087 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:09 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-84da4a83-9b3a-4eb1-91e9-284ce47c0a8a tempest-CinderUnicodeTest-1288583701 None] Created volume successfully. Aug 27 03:58:09 devstack sudo[114725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28 Aug 27 03:58:09 devstack sudo[114725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:09 devstack sudo[114725]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32b4f886-0f69-4263-b79f-03c83fe4c087 tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28" returned: 0 in 0.371s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32b4f886-0f69-4263-b79f-03c83fe4c087 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.18acc812-dca6-4ac0-9655-6166c06e43d9 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:10 devstack sudo[114730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.18acc812-dca6-4ac0-9655-6166c06e43d9 1G Aug 27 03:58:10 devstack sudo[114730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:10 devstack sudo[114730]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32b4f886-0f69-4263-b79f-03c83fe4c087 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.18acc812-dca6-4ac0-9655-6166c06e43d9 1G" returned: 0 in 0.415s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32b4f886-0f69-4263-b79f-03c83fe4c087 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.18acc812-dca6-4ac0-9655-6166c06e43d9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:10 devstack sudo[114735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.18acc812-dca6-4ac0-9655-6166c06e43d9 Aug 27 03:58:10 devstack sudo[114735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:10 devstack sudo[114735]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32b4f886-0f69-4263-b79f-03c83fe4c087 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.18acc812-dca6-4ac0-9655-6166c06e43d9" returned: 0 in 0.297s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:10 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-32b4f886-0f69-4263-b79f-03c83fe4c087 tempest-ProjectMemberTests-1426758417 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.18acc812-dca6-4ac0-9655-6166c06e43d9 is being set with open permissions: ugo+rw Aug 27 03:58:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32b4f886-0f69-4263-b79f-03c83fe4c087 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.18acc812-dca6-4ac0-9655-6166c06e43d9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:10 devstack sudo[114740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.18acc812-dca6-4ac0-9655-6166c06e43d9 Aug 27 03:58:10 devstack sudo[114740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8daf0230-2bab-4885-9001-445c494e1adb tempest-CinderUnicodeTest-1288583701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:10 devstack sudo[114740]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32b4f886-0f69-4263-b79f-03c83fe4c087 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.18acc812-dca6-4ac0-9655-6166c06e43d9" returned: 0 in 0.266s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32b4f886-0f69-4263-b79f-03c83fe4c087 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:11 devstack sudo[114743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.info Aug 27 03:58:11 devstack sudo[114743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:11 devstack sudo[114743]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32b4f886-0f69-4263-b79f-03c83fe4c087 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.info" returned: 0 in 0.249s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:11 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-32b4f886-0f69-4263-b79f-03c83fe4c087 tempest-ProjectMemberTests-1426758417 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.info is being set with open permissions: ugo+rw Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32b4f886-0f69-4263-b79f-03c83fe4c087 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:11 devstack sudo[114746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.info Aug 27 03:58:11 devstack sudo[114746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:11 devstack sudo[114746]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32b4f886-0f69-4263-b79f-03c83fe4c087 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.info" returned: 0 in 0.234s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-32b4f886-0f69-4263-b79f-03c83fe4c087 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.937s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.299s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1406105151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0657a07a-074d-41e2-a4a8-50bbe981b77d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='358466edca284540b0feb1aba1d2c1b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:09Z,use_quota=True,user_id='2f8195d32bca46b585a4529fe7fff7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Creating volume 0657a07a-074d-41e2-a4a8-50bbe981b77d {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:58:11 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:11 devstack sudo[114749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d 1073741824 Aug 27 03:58:11 devstack sudo[114749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:11 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-32b4f886-0f69-4263-b79f-03c83fe4c087 tempest-ProjectMemberTests-1426758417 None] Create snapshot completed successfully Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1fa4a45b-230d-466b-a7c5-cfcfa3c21e4c tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-18acc812-dca6-4ac0-9655-6166c06e43d9-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1fa4a45b-230d-466b-a7c5-cfcfa3c21e4c tempest-ProjectMemberTests-1426758417 None] Lock "cinder-18acc812-dca6-4ac0-9655-6166c06e43d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1fa4a45b-230d-466b-a7c5-cfcfa3c21e4c tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-596c98ec-6d56-4bbe-97b9-56a58fdbcc28" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1fa4a45b-230d-466b-a7c5-cfcfa3c21e4c tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-596c98ec-6d56-4bbe-97b9-56a58fdbcc28" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1fa4a45b-230d-466b-a7c5-cfcfa3c21e4c tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-18acc812-dca6-4ac0-9655-6166c06e43d9" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1fa4a45b-230d-466b-a7c5-cfcfa3c21e4c tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-18acc812-dca6-4ac0-9655-6166c06e43d9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-1fa4a45b-230d-466b-a7c5-cfcfa3c21e4c tempest-ProjectMemberTests-1426758417 None] Deleting offline snapshot 18acc812-dca6-4ac0-9655-6166c06e43d9 of volume 596c98ec-6d56-4bbe-97b9-56a58fdbcc28 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-1fa4a45b-230d-466b-a7c5-cfcfa3c21e4c tempest-ProjectMemberTests-1426758417 None] snapshot_file for this snap is: volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.18acc812-dca6-4ac0-9655-6166c06e43d9 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f61202-7467-46b3-955b-0b36a88b7029]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1fa4a45b-230d-466b-a7c5-cfcfa3c21e4c tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.18acc812-dca6-4ac0-9655-6166c06e43d9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:11 devstack sudo[114749]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d 1073741824" returned: 0 in 0.489s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:12 devstack sudo[114756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d Aug 27 03:58:12 devstack sudo[114756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:12 devstack sudo[114755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.18acc812-dca6-4ac0-9655-6166c06e43d9 Aug 27 03:58:12 devstack sudo[114755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:12 devstack sudo[114756]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d" returned: 0 in 0.249s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.881s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1822227170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a22177-dc0b-44bd-a146-462a69f8a1ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c91680c73ffe4d6e9be91c4d3a789e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:09Z,use_quota=True,user_id='5ebe86d5bb784b1ead724efed91e0b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Creating volume d4a22177-dc0b-44bd-a146-462a69f8a1ba {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:58:12 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8cc8a6-645c-494f-ac3a-f3de1a1d9270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0657a07a-074d-41e2-a4a8-50bbe981b77d', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1545b12-3f44-4fd1-96f6-9af858ae8bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:12 devstack sudo[114762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba 1073741824 Aug 27 03:58:12 devstack sudo[114762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:12 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Volume volume-0657a07a-074d-41e2-a4a8-50bbe981b77d (0657a07a-074d-41e2-a4a8-50bbe981b77d): created successfully Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1545b12-3f44-4fd1-96f6-9af858ae8bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Flow 'volume_create_manager' (0621ecc0-fdef-4f3a-9e78-e5890ffdd75a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:12 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-36d21f2e-4509-441d-a369-ed9be7dd0f7f tempest-VolumeDependencyTests-465344188 None] Created volume successfully. Aug 27 03:58:12 devstack sudo[114755]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1fa4a45b-230d-466b-a7c5-cfcfa3c21e4c tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.18acc812-dca6-4ac0-9655-6166c06e43d9" returned: 0 in 0.403s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-1fa4a45b-230d-466b-a7c5-cfcfa3c21e4c tempest-ProjectMemberTests-1426758417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1c74e3-9692-478d-b1ea-2162a5f01f56]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1fa4a45b-230d-466b-a7c5-cfcfa3c21e4c tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:12 devstack sudo[114765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28 Aug 27 03:58:12 devstack sudo[114765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:12 devstack sudo[114762]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba 1073741824" returned: 0 in 0.450s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:12 devstack sudo[114765]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1fa4a45b-230d-466b-a7c5-cfcfa3c21e4c tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28" returned: 0 in 0.389s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:12 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1fa4a45b-230d-466b-a7c5-cfcfa3c21e4c tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.18acc812-dca6-4ac0-9655-6166c06e43d9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:12 devstack sudo[114773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba Aug 27 03:58:12 devstack sudo[114773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:12 devstack sudo[114774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.18acc812-dca6-4ac0-9655-6166c06e43d9 Aug 27 03:58:12 devstack sudo[114774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:13 devstack sudo[114773]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba" returned: 0 in 0.281s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:13 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:58:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8daf0230-2bab-4885-9001-445c494e1adb tempest-CinderUnicodeTest-1288583701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.232s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3d23f9-363b-4d64-b74b-929431af8726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (961c461b-e25f-4cfc-9cba-b8ab5189f233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:13 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-8daf0230-2bab-4885-9001-445c494e1adb tempest-CinderUnicodeTest-1288583701 None] Creating offline snapshot a9c83368-1ac4-463f-9b78-8d30fde47397 of volume c2bf5646-4a6b-4e23-97c8-c53855dda2d9 {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:58:13 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Volume volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba (d4a22177-dc0b-44bd-a146-462a69f8a1ba): created successfully Aug 27 03:58:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (961c461b-e25f-4cfc-9cba-b8ab5189f233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:13 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Flow 'volume_create_manager' (34c2095b-5e20-4e5f-997d-9ef5e3f2c5f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:13 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6a0821-332e-45ee-98dd-ea1123c33065]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8daf0230-2bab-4885-9001-445c494e1adb tempest-CinderUnicodeTest-1288583701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:13 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-639f3d8c-37ca-4561-8b71-c947683b9e90 tempest-ProjectReaderTests-806833313 None] Created volume successfully. Aug 27 03:58:13 devstack sudo[114774]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1fa4a45b-230d-466b-a7c5-cfcfa3c21e4c tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.18acc812-dca6-4ac0-9655-6166c06e43d9" returned: 0 in 0.393s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1fa4a45b-230d-466b-a7c5-cfcfa3c21e4c tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.18acc812-dca6-4ac0-9655-6166c06e43d9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:13 devstack sudo[114783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.18acc812-dca6-4ac0-9655-6166c06e43d9 Aug 27 03:58:13 devstack sudo[114783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:13 devstack sudo[114782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9 Aug 27 03:58:13 devstack sudo[114782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ee1d4c3d-7d4e-4807-a80c-e463ab2df592 tempest-VolumeDependencyTests-465344188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:13 devstack sudo[114783]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1fa4a45b-230d-466b-a7c5-cfcfa3c21e4c tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28.18acc812-dca6-4ac0-9655-6166c06e43d9" returned: 0 in 0.280s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1fa4a45b-230d-466b-a7c5-cfcfa3c21e4c tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-18acc812-dca6-4ac0-9655-6166c06e43d9" released by "_delete_snapshot" :: held 1.566s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1fa4a45b-230d-466b-a7c5-cfcfa3c21e4c tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-596c98ec-6d56-4bbe-97b9-56a58fdbcc28" released by "delete_snapshot" :: held 1.593s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:13 devstack sudo[114782]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8daf0230-2bab-4885-9001-445c494e1adb tempest-CinderUnicodeTest-1288583701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9" returned: 0 in 0.437s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8daf0230-2bab-4885-9001-445c494e1adb tempest-CinderUnicodeTest-1288583701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.a9c83368-1ac4-463f-9b78-8d30fde47397 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:13 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-1fa4a45b-230d-466b-a7c5-cfcfa3c21e4c tempest-ProjectMemberTests-1426758417 None] Created reservations ['b1951e93-e6ac-45d1-8c9b-b1b0030c87f9', '9e8a29bc-6e1e-4e85-b5ab-db1ee056ed66', 'dee78586-b474-4ddc-9f13-f283b4aec417', '3377c631-a79f-4b54-8504-48146fa09782'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:13 devstack sudo[114791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.a9c83368-1ac4-463f-9b78-8d30fde47397 1G Aug 27 03:58:13 devstack sudo[114791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:13 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-1fa4a45b-230d-466b-a7c5-cfcfa3c21e4c tempest-ProjectMemberTests-1426758417 None] Delete snapshot completed successfully. Aug 27 03:58:13 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1fa4a45b-230d-466b-a7c5-cfcfa3c21e4c tempest-ProjectMemberTests-1426758417 None] Lock "cinder-18acc812-dca6-4ac0-9655-6166c06e43d9-delete_snapshot" released by "delete_snapshot" :: held 1.787s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-78eb4ef0-8cb0-402e-a7b0-b010b91f1b20 tempest-ProjectReaderTests-806833313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:13 devstack sudo[114791]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8daf0230-2bab-4885-9001-445c494e1adb tempest-CinderUnicodeTest-1288583701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.a9c83368-1ac4-463f-9b78-8d30fde47397 1G" returned: 0 in 0.412s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:13 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8daf0230-2bab-4885-9001-445c494e1adb tempest-CinderUnicodeTest-1288583701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.a9c83368-1ac4-463f-9b78-8d30fde47397 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:14 devstack sudo[114797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.a9c83368-1ac4-463f-9b78-8d30fde47397 Aug 27 03:58:14 devstack sudo[114797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d2e8ba76-bcad-40a1-bc30-020433bc9e33 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-596c98ec-6d56-4bbe-97b9-56a58fdbcc28-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d2e8ba76-bcad-40a1-bc30-020433bc9e33 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-596c98ec-6d56-4bbe-97b9-56a58fdbcc28-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d2e8ba76-bcad-40a1-bc30-020433bc9e33 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-596c98ec-6d56-4bbe-97b9-56a58fdbcc28" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d2e8ba76-bcad-40a1-bc30-020433bc9e33 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-596c98ec-6d56-4bbe-97b9-56a58fdbcc28" acquired by "delete_volume" :: waited 0.013s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[8066cf2d-a539-421c-bac3-3a1bae5f954d]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d2e8ba76-bcad-40a1-bc30-020433bc9e33 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:14 devstack sudo[114799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28 Aug 27 03:58:14 devstack sudo[114799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:14 devstack sudo[114797]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8daf0230-2bab-4885-9001-445c494e1adb tempest-CinderUnicodeTest-1288583701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.a9c83368-1ac4-463f-9b78-8d30fde47397" returned: 0 in 0.307s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:14 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-8daf0230-2bab-4885-9001-445c494e1adb tempest-CinderUnicodeTest-1288583701 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.a9c83368-1ac4-463f-9b78-8d30fde47397 is being set with open permissions: ugo+rw Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8daf0230-2bab-4885-9001-445c494e1adb tempest-CinderUnicodeTest-1288583701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.a9c83368-1ac4-463f-9b78-8d30fde47397 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:14 devstack sudo[114804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.a9c83368-1ac4-463f-9b78-8d30fde47397 Aug 27 03:58:14 devstack sudo[114804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:14 devstack sudo[114799]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d2e8ba76-bcad-40a1-bc30-020433bc9e33 tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28" returned: 0 in 0.361s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d2e8ba76-bcad-40a1-bc30-020433bc9e33 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:14 devstack sudo[114810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28 Aug 27 03:58:14 devstack sudo[114810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:14 devstack sudo[114804]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8daf0230-2bab-4885-9001-445c494e1adb tempest-CinderUnicodeTest-1288583701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.a9c83368-1ac4-463f-9b78-8d30fde47397" returned: 0 in 0.254s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8daf0230-2bab-4885-9001-445c494e1adb tempest-CinderUnicodeTest-1288583701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:14 devstack sudo[114812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.info Aug 27 03:58:14 devstack sudo[114812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:14 devstack sudo[114810]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d2e8ba76-bcad-40a1-bc30-020433bc9e33 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-596c98ec-6d56-4bbe-97b9-56a58fdbcc28" returned: 0 in 0.275s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d2e8ba76-bcad-40a1-bc30-020433bc9e33 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-596c98ec-6d56-4bbe-97b9-56a58fdbcc28" released by "delete_volume" :: held 0.696s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:14 devstack sudo[114812]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8daf0230-2bab-4885-9001-445c494e1adb tempest-CinderUnicodeTest-1288583701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.info" returned: 0 in 0.266s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:14 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-8daf0230-2bab-4885-9001-445c494e1adb tempest-CinderUnicodeTest-1288583701 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.info is being set with open permissions: ugo+rw Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8daf0230-2bab-4885-9001-445c494e1adb tempest-CinderUnicodeTest-1288583701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-d2e8ba76-bcad-40a1-bc30-020433bc9e33 tempest-ProjectMemberTests-1426758417 None] Created reservations ['30408567-c229-4230-9517-7a398631da74', '4989ea67-922f-4fd6-a7ef-f88df68355a1', '50d9596e-ee3d-454d-9393-b149b63ff874', 'c86dee2c-d0fb-460b-9d10-c3ff18330f73'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:14 devstack sudo[114816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.info Aug 27 03:58:14 devstack sudo[114816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:14 devstack sudo[114818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:58:14 devstack sudo[114818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d2e8ba76-bcad-40a1-bc30-020433bc9e33 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d2e8ba76-bcad-40a1-bc30-020433bc9e33 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d2e8ba76-bcad-40a1-bc30-020433bc9e33 tempest-ProjectMemberTests-1426758417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d2e8ba76-bcad-40a1-bc30-020433bc9e33 tempest-ProjectMemberTests-1426758417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d2e8ba76-bcad-40a1-bc30-020433bc9e33 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d2e8ba76-bcad-40a1-bc30-020433bc9e33 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:15 devstack sudo[114820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:58:15 devstack sudo[114820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:15 devstack sudo[114816]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8daf0230-2bab-4885-9001-445c494e1adb tempest-CinderUnicodeTest-1288583701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.info" returned: 0 in 0.276s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-8daf0230-2bab-4885-9001-445c494e1adb tempest-CinderUnicodeTest-1288583701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.088s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ee1d4c3d-7d4e-4807-a80c-e463ab2df592 tempest-VolumeDependencyTests-465344188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.858s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-ee1d4c3d-7d4e-4807-a80c-e463ab2df592 tempest-VolumeDependencyTests-465344188 None] Creating offline snapshot 307ff5f9-948c-429f-833c-a54dc955f352 of volume 0657a07a-074d-41e2-a4a8-50bbe981b77d {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:58:15 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-8daf0230-2bab-4885-9001-445c494e1adb tempest-CinderUnicodeTest-1288583701 None] Create snapshot completed successfully Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c51f8ed-746e-4ee7-b81b-f374e5f14fc9]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ee1d4c3d-7d4e-4807-a80c-e463ab2df592 tempest-VolumeDependencyTests-465344188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:15 devstack sudo[114818]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.306s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager._thread_info {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread count: 28 {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread info: [<_MainThread(MainThread, started 134250325188736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 03:58:15 devstack sudo[114820]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d2e8ba76-bcad-40a1-bc30-020433bc9e33 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.303s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-d2e8ba76-bcad-40a1-bc30-020433bc9e33 tempest-ProjectMemberTests-1426758417 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:58:15 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d2e8ba76-bcad-40a1-bc30-020433bc9e33 tempest-ProjectMemberTests-1426758417 None] Deleted volume successfully. Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d2e8ba76-bcad-40a1-bc30-020433bc9e33 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-596c98ec-6d56-4bbe-97b9-56a58fdbcc28-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:15 devstack sudo[114824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d Aug 27 03:58:15 devstack sudo[114824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:15 devstack sudo[114824]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ee1d4c3d-7d4e-4807-a80c-e463ab2df592 tempest-VolumeDependencyTests-465344188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d" returned: 0 in 0.416s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ee1d4c3d-7d4e-4807-a80c-e463ab2df592 tempest-VolumeDependencyTests-465344188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.307ff5f9-948c-429f-833c-a54dc955f352 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:15 devstack sudo[114830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.307ff5f9-948c-429f-833c-a54dc955f352 1G Aug 27 03:58:15 devstack sudo[114830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Flow 'volume_create_manager' (35f57069-a7fd-4859-906f-fbaaae405214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2970aa27-cfb2-4402-8b65-390c22446c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2970aa27-cfb2-4402-8b65-390c22446c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-755972711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb4a7e3-7293-4cdc-ac98-54ee61f1157a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8658e7bcb5964a65a4672729d843a24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:16Z,use_quota=True,user_id='d1b1c78558e94e16b33cfaf2594e5ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ba627c-e278-4d3b-b413-f30fc6e6c642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ba627c-e278-4d3b-b413-f30fc6e6c642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ec1ef5-f414-4468-bd12-6ad802ff8199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ec1ef5-f414-4468-bd12-6ad802ff8199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eb4a7e3-7293-4cdc-ac98-54ee61f1157a', 'volume_name': 'volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361b9143-ca47-4260-8d62-18f7e498c8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361b9143-ca47-4260-8d62-18f7e498c8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd69f45-aa40-4173-9d23-03a43d770d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:15 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Volume 3eb4a7e3-7293-4cdc-ac98-54ee61f1157a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a', 'volume_size': 1} Aug 27 03:58:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:16 devstack sudo[114830]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:16 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4841f6b1-7647-4ace-ac70-350274f22cfa tempest-CinderUnicodeTest-1288583701 None] Acquiring lock "cinder-a9c83368-1ac4-463f-9b78-8d30fde47397-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ee1d4c3d-7d4e-4807-a80c-e463ab2df592 tempest-VolumeDependencyTests-465344188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.307ff5f9-948c-429f-833c-a54dc955f352 1G" returned: 0 in 0.445s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ee1d4c3d-7d4e-4807-a80c-e463ab2df592 tempest-VolumeDependencyTests-465344188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0657a07a-074d-41e2-a4a8-50bbe981b77d -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.307ff5f9-948c-429f-833c-a54dc955f352 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:16 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4841f6b1-7647-4ace-ac70-350274f22cfa tempest-CinderUnicodeTest-1288583701 None] Lock "cinder-a9c83368-1ac4-463f-9b78-8d30fde47397-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:16 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4841f6b1-7647-4ace-ac70-350274f22cfa tempest-CinderUnicodeTest-1288583701 None] Acquiring lock "cinder-quobyte-c2bf5646-4a6b-4e23-97c8-c53855dda2d9" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:16 devstack sudo[114836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0657a07a-074d-41e2-a4a8-50bbe981b77d -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.307ff5f9-948c-429f-833c-a54dc955f352 Aug 27 03:58:16 devstack sudo[114836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:16 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4841f6b1-7647-4ace-ac70-350274f22cfa tempest-CinderUnicodeTest-1288583701 None] Lock "cinder-quobyte-c2bf5646-4a6b-4e23-97c8-c53855dda2d9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:16 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4841f6b1-7647-4ace-ac70-350274f22cfa tempest-CinderUnicodeTest-1288583701 None] Acquiring lock "cinder-quobyte-a9c83368-1ac4-463f-9b78-8d30fde47397" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:16 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4841f6b1-7647-4ace-ac70-350274f22cfa tempest-CinderUnicodeTest-1288583701 None] Lock "cinder-quobyte-a9c83368-1ac4-463f-9b78-8d30fde47397" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:16 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-4841f6b1-7647-4ace-ac70-350274f22cfa tempest-CinderUnicodeTest-1288583701 None] Deleting offline snapshot a9c83368-1ac4-463f-9b78-8d30fde47397 of volume c2bf5646-4a6b-4e23-97c8-c53855dda2d9 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:58:16 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-4841f6b1-7647-4ace-ac70-350274f22cfa tempest-CinderUnicodeTest-1288583701 None] snapshot_file for this snap is: volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.a9c83368-1ac4-463f-9b78-8d30fde47397 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:58:16 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acb4d8d-7b24-47fc-b6f4-40e23a7717c5]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4841f6b1-7647-4ace-ac70-350274f22cfa tempest-CinderUnicodeTest-1288583701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.a9c83368-1ac4-463f-9b78-8d30fde47397 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:16 devstack sudo[114838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.a9c83368-1ac4-463f-9b78-8d30fde47397 Aug 27 03:58:16 devstack sudo[114838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:16 devstack sudo[114836]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ee1d4c3d-7d4e-4807-a80c-e463ab2df592 tempest-VolumeDependencyTests-465344188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0657a07a-074d-41e2-a4a8-50bbe981b77d -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.307ff5f9-948c-429f-833c-a54dc955f352" returned: 0 in 0.318s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:16 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-ee1d4c3d-7d4e-4807-a80c-e463ab2df592 tempest-VolumeDependencyTests-465344188 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.307ff5f9-948c-429f-833c-a54dc955f352 is being set with open permissions: ugo+rw Aug 27 03:58:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ee1d4c3d-7d4e-4807-a80c-e463ab2df592 tempest-VolumeDependencyTests-465344188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.307ff5f9-948c-429f-833c-a54dc955f352 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:16 devstack sudo[114843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.307ff5f9-948c-429f-833c-a54dc955f352 Aug 27 03:58:16 devstack sudo[114843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:16 devstack sudo[114838]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4841f6b1-7647-4ace-ac70-350274f22cfa tempest-CinderUnicodeTest-1288583701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.a9c83368-1ac4-463f-9b78-8d30fde47397" returned: 0 in 0.379s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:16 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-4841f6b1-7647-4ace-ac70-350274f22cfa tempest-CinderUnicodeTest-1288583701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:58:16 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc40ca6e-4f46-4bb2-8627-ab7d8cc5e461]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4841f6b1-7647-4ace-ac70-350274f22cfa tempest-CinderUnicodeTest-1288583701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:16 devstack sudo[114843]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ee1d4c3d-7d4e-4807-a80c-e463ab2df592 tempest-VolumeDependencyTests-465344188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.307ff5f9-948c-429f-833c-a54dc955f352" returned: 0 in 0.262s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ee1d4c3d-7d4e-4807-a80c-e463ab2df592 tempest-VolumeDependencyTests-465344188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:16 devstack sudo[114848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9 Aug 27 03:58:16 devstack sudo[114848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:16 devstack sudo[114850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.info Aug 27 03:58:16 devstack sudo[114850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:16 devstack sudo[114850]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:16 devstack sudo[114848]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4841f6b1-7647-4ace-ac70-350274f22cfa tempest-CinderUnicodeTest-1288583701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9" returned: 0 in 0.382s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4841f6b1-7647-4ace-ac70-350274f22cfa tempest-CinderUnicodeTest-1288583701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.a9c83368-1ac4-463f-9b78-8d30fde47397 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ee1d4c3d-7d4e-4807-a80c-e463ab2df592 tempest-VolumeDependencyTests-465344188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.info" returned: 0 in 0.293s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:16 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-ee1d4c3d-7d4e-4807-a80c-e463ab2df592 tempest-VolumeDependencyTests-465344188 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.info is being set with open permissions: ugo+rw Aug 27 03:58:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ee1d4c3d-7d4e-4807-a80c-e463ab2df592 tempest-VolumeDependencyTests-465344188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:17 devstack sudo[114857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.a9c83368-1ac4-463f-9b78-8d30fde47397 Aug 27 03:58:17 devstack sudo[114857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:17 devstack sudo[114858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.info Aug 27 03:58:17 devstack sudo[114858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:17 devstack sudo[114858]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ee1d4c3d-7d4e-4807-a80c-e463ab2df592 tempest-VolumeDependencyTests-465344188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.info" returned: 0 in 0.253s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ee1d4c3d-7d4e-4807-a80c-e463ab2df592 tempest-VolumeDependencyTests-465344188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.099s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-78eb4ef0-8cb0-402e-a7b0-b010b91f1b20 tempest-ProjectReaderTests-806833313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.565s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:17 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-78eb4ef0-8cb0-402e-a7b0-b010b91f1b20 tempest-ProjectReaderTests-806833313 None] Creating offline snapshot 019a9ea9-6e4d-40f3-af90-67ad20409b54 of volume d4a22177-dc0b-44bd-a146-462a69f8a1ba {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:58:17 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-ee1d4c3d-7d4e-4807-a80c-e463ab2df592 tempest-VolumeDependencyTests-465344188 None] Create snapshot completed successfully Aug 27 03:58:17 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[701a0054-8c61-4bd1-9007-c188c7b53eba]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-78eb4ef0-8cb0-402e-a7b0-b010b91f1b20 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:17 devstack sudo[114857]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4841f6b1-7647-4ace-ac70-350274f22cfa tempest-CinderUnicodeTest-1288583701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.a9c83368-1ac4-463f-9b78-8d30fde47397" returned: 0 in 0.346s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4841f6b1-7647-4ace-ac70-350274f22cfa tempest-CinderUnicodeTest-1288583701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.a9c83368-1ac4-463f-9b78-8d30fde47397 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:17 devstack sudo[114866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.a9c83368-1ac4-463f-9b78-8d30fde47397 Aug 27 03:58:17 devstack sudo[114866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:17 devstack sudo[114865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba Aug 27 03:58:17 devstack sudo[114865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:17 devstack sudo[114866]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4841f6b1-7647-4ace-ac70-350274f22cfa tempest-CinderUnicodeTest-1288583701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9.a9c83368-1ac4-463f-9b78-8d30fde47397" returned: 0 in 0.253s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:17 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4841f6b1-7647-4ace-ac70-350274f22cfa tempest-CinderUnicodeTest-1288583701 None] Lock "cinder-quobyte-a9c83368-1ac4-463f-9b78-8d30fde47397" released by "_delete_snapshot" :: held 1.482s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:17 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4841f6b1-7647-4ace-ac70-350274f22cfa tempest-CinderUnicodeTest-1288583701 None] Lock "cinder-quobyte-c2bf5646-4a6b-4e23-97c8-c53855dda2d9" released by "delete_snapshot" :: held 1.503s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:17 devstack sudo[114865]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-78eb4ef0-8cb0-402e-a7b0-b010b91f1b20 tempest-ProjectReaderTests-806833313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba" returned: 0 in 0.365s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-78eb4ef0-8cb0-402e-a7b0-b010b91f1b20 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.019a9ea9-6e4d-40f3-af90-67ad20409b54 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:17 devstack sudo[114873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.019a9ea9-6e4d-40f3-af90-67ad20409b54 1G Aug 27 03:58:17 devstack sudo[114873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:17 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-4841f6b1-7647-4ace-ac70-350274f22cfa tempest-CinderUnicodeTest-1288583701 None] Created reservations ['71b6bd0f-863b-4d6d-b69b-3a41abbb0a8d', 'd76a7152-2495-4b60-8565-e4ffc961d8a4', '823fea2d-28b5-4239-b690-f760e2c8b8f5', 'e6be56bb-d90c-4a34-a5c5-2554645d6fd8'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:17 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-4841f6b1-7647-4ace-ac70-350274f22cfa tempest-CinderUnicodeTest-1288583701 None] Delete snapshot completed successfully. Aug 27 03:58:17 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-4841f6b1-7647-4ace-ac70-350274f22cfa tempest-CinderUnicodeTest-1288583701 None] Lock "cinder-a9c83368-1ac4-463f-9b78-8d30fde47397-delete_snapshot" released by "delete_snapshot" :: held 1.734s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Flow 'volume_create_manager' (b1af0455-6cc5-4cc1-becb-252681003dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f68adbf-300d-4cbd-b8c7-a812efe91246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f68adbf-300d-4cbd-b8c7-a812efe91246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1392483295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a2c54a-a768-430f-bba8-d9eb2ac510b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='358466edca284540b0feb1aba1d2c1b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=307ff5f9-948c-429f-833c-a54dc955f352,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:18Z,use_quota=True,user_id='2f8195d32bca46b585a4529fe7fff7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd900df-af08-419e-953a-036a3a53f662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd900df-af08-419e-953a-036a3a53f662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87644e3-c81d-4281-8507-2a3954fcd49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87644e3-c81d-4281-8507-2a3954fcd49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b2a2c54a-a768-430f-bba8-d9eb2ac510b2', 'volume_name': 'volume-b2a2c54a-a768-430f-bba8-d9eb2ac510b2', 'volume_size': 1, 'snapshot_id': '307ff5f9-948c-429f-833c-a54dc955f352'}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:18 devstack sudo[114873]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a3d4a5-b90e-46f5-bf52-41ad53757678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a3d4a5-b90e-46f5-bf52-41ad53757678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c71a1b-aad7-418f-a463-dff8c3b70ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:18 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Volume b2a2c54a-a768-430f-bba8-d9eb2ac510b2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b2a2c54a-a768-430f-bba8-d9eb2ac510b2', 'volume_size': 1, 'snapshot_id': '307ff5f9-948c-429f-833c-a54dc955f352'} Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-78eb4ef0-8cb0-402e-a7b0-b010b91f1b20 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.019a9ea9-6e4d-40f3-af90-67ad20409b54 1G" returned: 0 in 0.513s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-78eb4ef0-8cb0-402e-a7b0-b010b91f1b20 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.019a9ea9-6e4d-40f3-af90-67ad20409b54 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:18 devstack sudo[114913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.019a9ea9-6e4d-40f3-af90-67ad20409b54 Aug 27 03:58:18 devstack sudo[114913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9f0af56a-d68e-4a96-ad61-c563861ad930 tempest-CinderUnicodeTest-1288583701 None] Acquiring lock "cinder-c2bf5646-4a6b-4e23-97c8-c53855dda2d9-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9f0af56a-d68e-4a96-ad61-c563861ad930 tempest-CinderUnicodeTest-1288583701 None] Lock "cinder-c2bf5646-4a6b-4e23-97c8-c53855dda2d9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9f0af56a-d68e-4a96-ad61-c563861ad930 tempest-CinderUnicodeTest-1288583701 None] Acquiring lock "cinder-quobyte-c2bf5646-4a6b-4e23-97c8-c53855dda2d9" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9f0af56a-d68e-4a96-ad61-c563861ad930 tempest-CinderUnicodeTest-1288583701 None] Lock "cinder-quobyte-c2bf5646-4a6b-4e23-97c8-c53855dda2d9" acquired by "delete_volume" :: waited 0.016s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[5640cbbe-d8c7-413d-aa64-4e02c6649059]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9f0af56a-d68e-4a96-ad61-c563861ad930 tempest-CinderUnicodeTest-1288583701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:18 devstack sudo[114917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9 Aug 27 03:58:18 devstack sudo[114917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:18 devstack sudo[114913]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-78eb4ef0-8cb0-402e-a7b0-b010b91f1b20 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.019a9ea9-6e4d-40f3-af90-67ad20409b54" returned: 0 in 0.423s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:18 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-78eb4ef0-8cb0-402e-a7b0-b010b91f1b20 tempest-ProjectReaderTests-806833313 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.019a9ea9-6e4d-40f3-af90-67ad20409b54 is being set with open permissions: ugo+rw Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-78eb4ef0-8cb0-402e-a7b0-b010b91f1b20 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.019a9ea9-6e4d-40f3-af90-67ad20409b54 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:18 devstack sudo[114922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.019a9ea9-6e4d-40f3-af90-67ad20409b54 Aug 27 03:58:18 devstack sudo[114922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:18 devstack sudo[114917]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9f0af56a-d68e-4a96-ad61-c563861ad930 tempest-CinderUnicodeTest-1288583701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9" returned: 0 in 0.391s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9f0af56a-d68e-4a96-ad61-c563861ad930 tempest-CinderUnicodeTest-1288583701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:18 devstack sudo[114927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9 Aug 27 03:58:18 devstack sudo[114927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:18 devstack sudo[114922]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-78eb4ef0-8cb0-402e-a7b0-b010b91f1b20 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.019a9ea9-6e4d-40f3-af90-67ad20409b54" returned: 0 in 0.253s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-78eb4ef0-8cb0-402e-a7b0-b010b91f1b20 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:18 devstack sudo[114930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.info Aug 27 03:58:18 devstack sudo[114930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:19 devstack sudo[114927]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9f0af56a-d68e-4a96-ad61-c563861ad930 tempest-CinderUnicodeTest-1288583701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c2bf5646-4a6b-4e23-97c8-c53855dda2d9" returned: 0 in 0.274s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9f0af56a-d68e-4a96-ad61-c563861ad930 tempest-CinderUnicodeTest-1288583701 None] Lock "cinder-quobyte-c2bf5646-4a6b-4e23-97c8-c53855dda2d9" released by "delete_volume" :: held 0.760s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:19 devstack sudo[114930]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-78eb4ef0-8cb0-402e-a7b0-b010b91f1b20 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.info" returned: 0 in 0.255s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:19 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-78eb4ef0-8cb0-402e-a7b0-b010b91f1b20 tempest-ProjectReaderTests-806833313 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.info is being set with open permissions: ugo+rw Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-78eb4ef0-8cb0-402e-a7b0-b010b91f1b20 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-9f0af56a-d68e-4a96-ad61-c563861ad930 tempest-CinderUnicodeTest-1288583701 None] Created reservations ['5bbac49c-aecf-4869-b52f-30270f2de8b2', '4e382eaf-4854-4d75-8098-fff95e25ff5b', 'c38e5e3b-8091-4bdd-8b80-1dd8cb0b03c4', 'c03ee611-0770-4651-8647-83d25d318750'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:19 devstack sudo[114934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.info Aug 27 03:58:19 devstack sudo[114934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9f0af56a-d68e-4a96-ad61-c563861ad930 tempest-CinderUnicodeTest-1288583701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9f0af56a-d68e-4a96-ad61-c563861ad930 tempest-CinderUnicodeTest-1288583701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-9f0af56a-d68e-4a96-ad61-c563861ad930 tempest-CinderUnicodeTest-1288583701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-9f0af56a-d68e-4a96-ad61-c563861ad930 tempest-CinderUnicodeTest-1288583701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-9f0af56a-d68e-4a96-ad61-c563861ad930 tempest-CinderUnicodeTest-1288583701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9f0af56a-d68e-4a96-ad61-c563861ad930 tempest-CinderUnicodeTest-1288583701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:19 devstack sudo[114936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:58:19 devstack sudo[114936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:19 devstack sudo[114934]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-78eb4ef0-8cb0-402e-a7b0-b010b91f1b20 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.info" returned: 0 in 0.237s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-78eb4ef0-8cb0-402e-a7b0-b010b91f1b20 tempest-ProjectReaderTests-806833313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.140s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.608s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-755972711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb4a7e3-7293-4cdc-ac98-54ee61f1157a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8658e7bcb5964a65a4672729d843a24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:16Z,use_quota=True,user_id='d1b1c78558e94e16b33cfaf2594e5ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Creating volume 3eb4a7e3-7293-4cdc-ac98-54ee61f1157a {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:58:19 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:19 devstack sudo[114939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a 1073741824 Aug 27 03:58:19 devstack sudo[114939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:19 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-78eb4ef0-8cb0-402e-a7b0-b010b91f1b20 tempest-ProjectReaderTests-806833313 None] Create snapshot completed successfully Aug 27 03:58:19 devstack sudo[114936]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-9f0af56a-d68e-4a96-ad61-c563861ad930 tempest-CinderUnicodeTest-1288583701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.276s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-9f0af56a-d68e-4a96-ad61-c563861ad930 tempest-CinderUnicodeTest-1288583701 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:58:19 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-9f0af56a-d68e-4a96-ad61-c563861ad930 tempest-CinderUnicodeTest-1288583701 None] Deleted volume successfully. Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-130f9fe3-5fd0-4b9c-8fbe-0866e62f5e05 tempest-CinderUnicodeTest-1288583701 None] Acquiring lock "cinder-c54d0461-ecec-44c0-95f0-6d4949f6f43c-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-9f0af56a-d68e-4a96-ad61-c563861ad930 tempest-CinderUnicodeTest-1288583701 None] Lock "cinder-c2bf5646-4a6b-4e23-97c8-c53855dda2d9-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-130f9fe3-5fd0-4b9c-8fbe-0866e62f5e05 tempest-CinderUnicodeTest-1288583701 None] Lock "cinder-c54d0461-ecec-44c0-95f0-6d4949f6f43c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-130f9fe3-5fd0-4b9c-8fbe-0866e62f5e05 tempest-CinderUnicodeTest-1288583701 None] Acquiring lock "cinder-quobyte-c54d0461-ecec-44c0-95f0-6d4949f6f43c" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-130f9fe3-5fd0-4b9c-8fbe-0866e62f5e05 tempest-CinderUnicodeTest-1288583701 None] Lock "cinder-quobyte-c54d0461-ecec-44c0-95f0-6d4949f6f43c" acquired by "delete_volume" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf0fef0-ca4f-4aff-a52a-521155e8f864]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-130f9fe3-5fd0-4b9c-8fbe-0866e62f5e05 tempest-CinderUnicodeTest-1288583701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c54d0461-ecec-44c0-95f0-6d4949f6f43c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:19 devstack sudo[114943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c54d0461-ecec-44c0-95f0-6d4949f6f43c Aug 27 03:58:19 devstack sudo[114943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:19 devstack sudo[114939]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a 1073741824" returned: 0 in 0.500s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:19 devstack sudo[114949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a Aug 27 03:58:19 devstack sudo[114949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1fd0f3b4-3c0e-439e-9317-55d9c8d9dd7e tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-019a9ea9-6e4d-40f3-af90-67ad20409b54-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1fd0f3b4-3c0e-439e-9317-55d9c8d9dd7e tempest-ProjectReaderTests-806833313 None] Lock "cinder-019a9ea9-6e4d-40f3-af90-67ad20409b54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1fd0f3b4-3c0e-439e-9317-55d9c8d9dd7e tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-quobyte-d4a22177-dc0b-44bd-a146-462a69f8a1ba" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1fd0f3b4-3c0e-439e-9317-55d9c8d9dd7e tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-d4a22177-dc0b-44bd-a146-462a69f8a1ba" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1fd0f3b4-3c0e-439e-9317-55d9c8d9dd7e tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-quobyte-019a9ea9-6e4d-40f3-af90-67ad20409b54" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:20 devstack sudo[114943]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-130f9fe3-5fd0-4b9c-8fbe-0866e62f5e05 tempest-CinderUnicodeTest-1288583701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c54d0461-ecec-44c0-95f0-6d4949f6f43c" returned: 0 in 0.413s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-130f9fe3-5fd0-4b9c-8fbe-0866e62f5e05 tempest-CinderUnicodeTest-1288583701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c54d0461-ecec-44c0-95f0-6d4949f6f43c {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:20 devstack sudo[114952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c54d0461-ecec-44c0-95f0-6d4949f6f43c Aug 27 03:58:20 devstack sudo[114952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1fd0f3b4-3c0e-439e-9317-55d9c8d9dd7e tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-019a9ea9-6e4d-40f3-af90-67ad20409b54" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-1fd0f3b4-3c0e-439e-9317-55d9c8d9dd7e tempest-ProjectReaderTests-806833313 None] Deleting offline snapshot 019a9ea9-6e4d-40f3-af90-67ad20409b54 of volume d4a22177-dc0b-44bd-a146-462a69f8a1ba {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-1fd0f3b4-3c0e-439e-9317-55d9c8d9dd7e tempest-ProjectReaderTests-806833313 None] snapshot_file for this snap is: volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.019a9ea9-6e4d-40f3-af90-67ad20409b54 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[c058648e-a4b3-426d-b613-1e821f41ecc3]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1fd0f3b4-3c0e-439e-9317-55d9c8d9dd7e tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.019a9ea9-6e4d-40f3-af90-67ad20409b54 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:20 devstack sudo[114949]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:20 devstack sudo[114954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.019a9ea9-6e4d-40f3-af90-67ad20409b54 Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a" returned: 0 in 0.301s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:20 devstack sudo[114954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.051s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Acquiring lock "cinder-quobyte-307ff5f9-948c-429f-833c-a54dc955f352-b2a2c54a-a768-430f-bba8-d9eb2ac510b2" by "_create_volume_from_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd69f45-aa40-4173-9d23-03a43d770d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba96e5b-bbf0-44b9-a34c-7c521867b11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Lock "cinder-quobyte-307ff5f9-948c-429f-833c-a54dc955f352-b2a2c54a-a768-430f-bba8-d9eb2ac510b2" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Creating volume b2a2c54a-a768-430f-bba8-d9eb2ac510b2 from snapshot 307ff5f9-948c-429f-833c-a54dc955f352 {{(pid=94328) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Acquiring lock "cinder-quobyte-b2a2c54a-a768-430f-bba8-d9eb2ac510b2" by "_copy_volume_from_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:20 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Volume volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a (3eb4a7e3-7293-4cdc-ac98-54ee61f1157a): created successfully Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba96e5b-bbf0-44b9-a34c-7c521867b11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Flow 'volume_create_manager' (35f57069-a7fd-4859-906f-fbaaae405214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Lock "cinder-quobyte-b2a2c54a-a768-430f-bba8-d9eb2ac510b2" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] snapshot: 307ff5f9-948c-429f-833c-a54dc955f352, volume: b2a2c54a-a768-430f-bba8-d9eb2ac510b2, {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 27 03:58:20 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-852fb777-2f7c-46b7-a4e9-c6e842d6b488 tempest-ProjectMemberTests-1426758417 None] Created volume successfully. Aug 27 03:58:20 devstack sudo[114952]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-130f9fe3-5fd0-4b9c-8fbe-0866e62f5e05 tempest-CinderUnicodeTest-1288583701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-c54d0461-ecec-44c0-95f0-6d4949f6f43c" returned: 0 in 0.331s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-130f9fe3-5fd0-4b9c-8fbe-0866e62f5e05 tempest-CinderUnicodeTest-1288583701 None] Lock "cinder-quobyte-c54d0461-ecec-44c0-95f0-6d4949f6f43c" released by "delete_volume" :: held 0.783s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ef71e9-e4de-49f4-8a50-fa015766ceb4]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.307ff5f9-948c-429f-833c-a54dc955f352 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-130f9fe3-5fd0-4b9c-8fbe-0866e62f5e05 tempest-CinderUnicodeTest-1288583701 None] Created reservations ['885ed4b5-90e9-40d1-995d-473eb8a8fc11', '3b322291-f177-484c-ae78-68bb914389f7', '5a5ff52f-df03-4bd5-a14d-38d1454f6dad', 'd2f4e83b-a8a1-4a8d-a32f-219bd9733d22'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:20 devstack sudo[114958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.307ff5f9-948c-429f-833c-a54dc955f352 Aug 27 03:58:20 devstack sudo[114958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-130f9fe3-5fd0-4b9c-8fbe-0866e62f5e05 tempest-CinderUnicodeTest-1288583701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-130f9fe3-5fd0-4b9c-8fbe-0866e62f5e05 tempest-CinderUnicodeTest-1288583701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-130f9fe3-5fd0-4b9c-8fbe-0866e62f5e05 tempest-CinderUnicodeTest-1288583701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-130f9fe3-5fd0-4b9c-8fbe-0866e62f5e05 tempest-CinderUnicodeTest-1288583701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-130f9fe3-5fd0-4b9c-8fbe-0866e62f5e05 tempest-CinderUnicodeTest-1288583701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-130f9fe3-5fd0-4b9c-8fbe-0866e62f5e05 tempest-CinderUnicodeTest-1288583701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:20 devstack sudo[114954]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1fd0f3b4-3c0e-439e-9317-55d9c8d9dd7e tempest-ProjectReaderTests-806833313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.019a9ea9-6e4d-40f3-af90-67ad20409b54" returned: 0 in 0.432s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-1fd0f3b4-3c0e-439e-9317-55d9c8d9dd7e tempest-ProjectReaderTests-806833313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:58:20 devstack sudo[114963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:58:20 devstack sudo[114963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[d289d11a-14f8-49f7-8361-cb1a696f0148]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1fd0f3b4-3c0e-439e-9317-55d9c8d9dd7e tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:20 devstack sudo[114965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba Aug 27 03:58:20 devstack sudo[114965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:20 devstack sudo[114963]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-130f9fe3-5fd0-4b9c-8fbe-0866e62f5e05 tempest-CinderUnicodeTest-1288583701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.291s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-130f9fe3-5fd0-4b9c-8fbe-0866e62f5e05 tempest-CinderUnicodeTest-1288583701 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:58:20 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-130f9fe3-5fd0-4b9c-8fbe-0866e62f5e05 tempest-CinderUnicodeTest-1288583701 None] Deleted volume successfully. Aug 27 03:58:20 devstack sudo[114958]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.307ff5f9-948c-429f-833c-a54dc955f352" returned: 0 in 0.472s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0657a07a-074d-41e2-a4a8-50bbe981b77d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-130f9fe3-5fd0-4b9c-8fbe-0866e62f5e05 tempest-CinderUnicodeTest-1288583701 None] Lock "cinder-c54d0461-ecec-44c0-95f0-6d4949f6f43c-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee51ddb-d701-4e13-83e9-7349136a9bb6]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:20 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:21 devstack sudo[114972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d Aug 27 03:58:21 devstack sudo[114972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:21 devstack sudo[114965]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1fd0f3b4-3c0e-439e-9317-55d9c8d9dd7e tempest-ProjectReaderTests-806833313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba" returned: 0 in 0.475s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1fd0f3b4-3c0e-439e-9317-55d9c8d9dd7e tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.019a9ea9-6e4d-40f3-af90-67ad20409b54 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:21 devstack sudo[114977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.019a9ea9-6e4d-40f3-af90-67ad20409b54 Aug 27 03:58:21 devstack sudo[114977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7e5b7faa-b6d1-48ac-9d04-69039d2c1d76 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:21 devstack sudo[114972]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d" returned: 0 in 0.525s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:21 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] will copy from snapshot at /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 27 03:58:21 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Creating direct copy from snapshot {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 27 03:58:21 devstack cinder-volume[94328]: DEBUG cinder.utils [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Path /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2a2c54a-a768-430f-bba8-d9eb2ac510b2 not found in is_blk_device check {{(pid=94328) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 27 03:58:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2a2c54a-a768-430f-bba8-d9eb2ac510b2 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:21 devstack sudo[114986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2a2c54a-a768-430f-bba8-d9eb2ac510b2 Aug 27 03:58:21 devstack sudo[114986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:21 devstack sudo[114977]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1fd0f3b4-3c0e-439e-9317-55d9c8d9dd7e tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.019a9ea9-6e4d-40f3-af90-67ad20409b54" returned: 0 in 0.466s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1fd0f3b4-3c0e-439e-9317-55d9c8d9dd7e tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.019a9ea9-6e4d-40f3-af90-67ad20409b54 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:21 devstack sudo[114989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.019a9ea9-6e4d-40f3-af90-67ad20409b54 Aug 27 03:58:21 devstack sudo[114989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:21 devstack sudo[114989]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:21 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1fd0f3b4-3c0e-439e-9317-55d9c8d9dd7e tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba.019a9ea9-6e4d-40f3-af90-67ad20409b54" returned: 0 in 0.364s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:21 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1fd0f3b4-3c0e-439e-9317-55d9c8d9dd7e tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-019a9ea9-6e4d-40f3-af90-67ad20409b54" released by "_delete_snapshot" :: held 1.856s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:21 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1fd0f3b4-3c0e-439e-9317-55d9c8d9dd7e tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-d4a22177-dc0b-44bd-a146-462a69f8a1ba" released by "delete_snapshot" :: held 1.922s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:21 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:UPDATE=343,cinder:SELECT=274,cinder:DELETE=30,cinder:INSERT=90 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:58:22 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-1fd0f3b4-3c0e-439e-9317-55d9c8d9dd7e tempest-ProjectReaderTests-806833313 None] Created reservations ['0fc390ff-af4a-4ce3-aa9d-aedb29a0fad6', '312f1ac5-971a-480b-bda4-579652a03b00', 'd0f678cd-a60a-40d5-aa3b-b10065572cf2', 'f4bc28a6-611f-4476-96e6-406f35dfd934'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:22 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=260,cinder:UPDATE=361,cinder:INSERT=101,cinder:DELETE=34 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:58:22 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-1fd0f3b4-3c0e-439e-9317-55d9c8d9dd7e tempest-ProjectReaderTests-806833313 None] Delete snapshot completed successfully. Aug 27 03:58:22 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1fd0f3b4-3c0e-439e-9317-55d9c8d9dd7e tempest-ProjectReaderTests-806833313 None] Lock "cinder-019a9ea9-6e4d-40f3-af90-67ad20409b54-delete_snapshot" released by "delete_snapshot" :: held 2.265s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:23 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c849c36f-9bc0-49f6-8838-7e019ecfa5b4 tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-d4a22177-dc0b-44bd-a146-462a69f8a1ba-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:23 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c849c36f-9bc0-49f6-8838-7e019ecfa5b4 tempest-ProjectReaderTests-806833313 None] Lock "cinder-d4a22177-dc0b-44bd-a146-462a69f8a1ba-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:23 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c849c36f-9bc0-49f6-8838-7e019ecfa5b4 tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-quobyte-d4a22177-dc0b-44bd-a146-462a69f8a1ba" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:23 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c849c36f-9bc0-49f6-8838-7e019ecfa5b4 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-d4a22177-dc0b-44bd-a146-462a69f8a1ba" acquired by "delete_volume" :: waited 0.041s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:23 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f49f373-57fc-4d27-8c92-371f343916e8]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:23 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c849c36f-9bc0-49f6-8838-7e019ecfa5b4 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:23 devstack sudo[115003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba Aug 27 03:58:23 devstack sudo[115003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:24 devstack sudo[115003]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c849c36f-9bc0-49f6-8838-7e019ecfa5b4 tempest-ProjectReaderTests-806833313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba" returned: 0 in 0.648s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:24 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c849c36f-9bc0-49f6-8838-7e019ecfa5b4 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:24 devstack sudo[115009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba Aug 27 03:58:24 devstack sudo[115009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:25 devstack sudo[115009]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c849c36f-9bc0-49f6-8838-7e019ecfa5b4 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d4a22177-dc0b-44bd-a146-462a69f8a1ba" returned: 0 in 0.735s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:25 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c849c36f-9bc0-49f6-8838-7e019ecfa5b4 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-d4a22177-dc0b-44bd-a146-462a69f8a1ba" released by "delete_volume" :: held 1.547s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:25 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-c849c36f-9bc0-49f6-8838-7e019ecfa5b4 tempest-ProjectReaderTests-806833313 None] Created reservations ['0d314f5d-5a43-4bd3-a4d1-e0be35d4d595', 'fbd4b1a3-20c9-4af8-8583-04659fbf094c', '768168f2-3c1e-42f4-857a-8a9b84b6de8a', 'b193199b-d4fd-4e41-aa10-961d01b7e3bc'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c849c36f-9bc0-49f6-8838-7e019ecfa5b4 tempest-ProjectReaderTests-806833313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c849c36f-9bc0-49f6-8838-7e019ecfa5b4 tempest-ProjectReaderTests-806833313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:25 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c849c36f-9bc0-49f6-8838-7e019ecfa5b4 tempest-ProjectReaderTests-806833313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:25 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-c849c36f-9bc0-49f6-8838-7e019ecfa5b4 tempest-ProjectReaderTests-806833313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-c849c36f-9bc0-49f6-8838-7e019ecfa5b4 tempest-ProjectReaderTests-806833313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:25 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c849c36f-9bc0-49f6-8838-7e019ecfa5b4 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:25 devstack sudo[115012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:58:25 devstack sudo[115012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:26 devstack sudo[115012]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:26 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-c849c36f-9bc0-49f6-8838-7e019ecfa5b4 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.572s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:26 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-c849c36f-9bc0-49f6-8838-7e019ecfa5b4 tempest-ProjectReaderTests-806833313 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:58:26 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-c849c36f-9bc0-49f6-8838-7e019ecfa5b4 tempest-ProjectReaderTests-806833313 None] Deleted volume successfully. Aug 27 03:58:26 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-c849c36f-9bc0-49f6-8838-7e019ecfa5b4 tempest-ProjectReaderTests-806833313 None] Lock "cinder-d4a22177-dc0b-44bd-a146-462a69f8a1ba-delete_volume" released by "delete_volume" :: held 2.705s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:27 devstack sudo[114986]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2a2c54a-a768-430f-bba8-d9eb2ac510b2" returned: 0 in 5.703s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Image conversion details: src /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2a2c54a-a768-430f-bba8-d9eb2ac510b2 {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 03:58:27 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Converted 1024.00 MB image at 179.54 MB/s Aug 27 03:58:27 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2a2c54a-a768-430f-bba8-d9eb2ac510b2 is being set with open permissions: ugo+rw Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2a2c54a-a768-430f-bba8-d9eb2ac510b2 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:27 devstack sudo[115021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2a2c54a-a768-430f-bba8-d9eb2ac510b2 Aug 27 03:58:27 devstack sudo[115021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Flow 'volume_create_manager' (4452d19c-919b-4df6-92aa-08739e6abf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1b75e3-b07b-4c5b-bd84-24a7fa583afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1b75e3-b07b-4c5b-bd84-24a7fa583afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-829745029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd153b15-bfb3-4755-9fef-f27df4f3c029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c91680c73ffe4d6e9be91c4d3a789e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:27Z,use_quota=True,user_id='5ebe86d5bb784b1ead724efed91e0b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f493d05-cb67-4aaf-9019-10e5adc9a46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f493d05-cb67-4aaf-9019-10e5adc9a46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb1f7b8-fa6d-4a91-92f4-5e57853a993e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb1f7b8-fa6d-4a91-92f4-5e57853a993e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd153b15-bfb3-4755-9fef-f27df4f3c029', 'volume_name': 'volume-dd153b15-bfb3-4755-9fef-f27df4f3c029', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3784ef3b-8f69-4d8e-b809-037732304a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3784ef3b-8f69-4d8e-b809-037732304a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de06a25-2648-4b3e-b467-100be744cc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:27 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Volume dd153b15-bfb3-4755-9fef-f27df4f3c029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd153b15-bfb3-4755-9fef-f27df4f3c029', 'volume_size': 1} Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:27 devstack sudo[115021]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2a2c54a-a768-430f-bba8-d9eb2ac510b2" returned: 0 in 0.271s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Lock "cinder-quobyte-b2a2c54a-a768-430f-bba8-d9eb2ac510b2" released by "_copy_volume_from_snapshot" :: held 7.086s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Lock "cinder-quobyte-307ff5f9-948c-429f-833c-a54dc955f352-b2a2c54a-a768-430f-bba8-d9eb2ac510b2" released by "_create_volume_from_snapshot" :: held 7.158s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.202s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7e5b7faa-b6d1-48ac-9d04-69039d2c1d76 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.186s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-7e5b7faa-b6d1-48ac-9d04-69039d2c1d76 tempest-ProjectMemberTests-1426758417 None] Creating offline snapshot 7fc7293b-1e2f-4376-b398-dab6c7367d81 of volume 3eb4a7e3-7293-4cdc-ac98-54ee61f1157a {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c71a1b-aad7-418f-a463-dff8c3b70ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2a2c54a-a768-430f-bba8-d9eb2ac510b2', 'volume_size': 1, 'snapshot_id': '307ff5f9-948c-429f-833c-a54dc955f352'}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c55260c-5db5-4071-aefe-6eae665d5f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06521b4-f65d-4f72-b672-1ba84fd5260c]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7e5b7faa-b6d1-48ac-9d04-69039d2c1d76 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-c0807137-2f5f-4162-9d65-e2baf8a16853 tempest-ProjectAdminTests-1148915275 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.739345550537, 'free_capacity_gb': 1774.739345550537, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94328) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 27 03:58:27 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Volume volume-b2a2c54a-a768-430f-bba8-d9eb2ac510b2 (b2a2c54a-a768-430f-bba8-d9eb2ac510b2): created successfully Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c55260c-5db5-4071-aefe-6eae665d5f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Flow 'volume_create_manager' (b1af0455-6cc5-4cc1-becb-252681003dd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:27 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-1b266123-d25e-457f-a2b7-7da7cec0e5b3 tempest-VolumeDependencyTests-465344188 None] Created volume successfully. Aug 27 03:58:27 devstack sudo[115024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a Aug 27 03:58:27 devstack sudo[115024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:27 devstack sudo[115024]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7e5b7faa-b6d1-48ac-9d04-69039d2c1d76 tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a" returned: 0 in 0.375s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7e5b7faa-b6d1-48ac-9d04-69039d2c1d76 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.7fc7293b-1e2f-4376-b398-dab6c7367d81 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:27 devstack sudo[115029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.7fc7293b-1e2f-4376-b398-dab6c7367d81 1G Aug 27 03:58:27 devstack sudo[115029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-32388b57-98e7-4ec9-b1e2-88f77298ac5a tempest-VolumeDependencyTests-465344188 None] Acquiring lock "cinder-307ff5f9-948c-429f-833c-a54dc955f352-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-32388b57-98e7-4ec9-b1e2-88f77298ac5a tempest-VolumeDependencyTests-465344188 None] Lock "cinder-307ff5f9-948c-429f-833c-a54dc955f352-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-32388b57-98e7-4ec9-b1e2-88f77298ac5a tempest-VolumeDependencyTests-465344188 None] Acquiring lock "cinder-quobyte-0657a07a-074d-41e2-a4a8-50bbe981b77d" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-32388b57-98e7-4ec9-b1e2-88f77298ac5a tempest-VolumeDependencyTests-465344188 None] Lock "cinder-quobyte-0657a07a-074d-41e2-a4a8-50bbe981b77d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-32388b57-98e7-4ec9-b1e2-88f77298ac5a tempest-VolumeDependencyTests-465344188 None] Acquiring lock "cinder-quobyte-307ff5f9-948c-429f-833c-a54dc955f352" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-32388b57-98e7-4ec9-b1e2-88f77298ac5a tempest-VolumeDependencyTests-465344188 None] Lock "cinder-quobyte-307ff5f9-948c-429f-833c-a54dc955f352" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:28 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-32388b57-98e7-4ec9-b1e2-88f77298ac5a tempest-VolumeDependencyTests-465344188 None] Deleting offline snapshot 307ff5f9-948c-429f-833c-a54dc955f352 of volume 0657a07a-074d-41e2-a4a8-50bbe981b77d {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:58:28 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-32388b57-98e7-4ec9-b1e2-88f77298ac5a tempest-VolumeDependencyTests-465344188 None] snapshot_file for this snap is: volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.307ff5f9-948c-429f-833c-a54dc955f352 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:58:28 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9b6bc8-3553-414e-9cfc-4db87a4c110c]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32388b57-98e7-4ec9-b1e2-88f77298ac5a tempest-VolumeDependencyTests-465344188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.307ff5f9-948c-429f-833c-a54dc955f352 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:28 devstack sudo[115029]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7e5b7faa-b6d1-48ac-9d04-69039d2c1d76 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.7fc7293b-1e2f-4376-b398-dab6c7367d81 1G" returned: 0 in 0.469s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7e5b7faa-b6d1-48ac-9d04-69039d2c1d76 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.7fc7293b-1e2f-4376-b398-dab6c7367d81 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:28 devstack sudo[115036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.7fc7293b-1e2f-4376-b398-dab6c7367d81 Aug 27 03:58:28 devstack sudo[115036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:28 devstack sudo[115035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.307ff5f9-948c-429f-833c-a54dc955f352 Aug 27 03:58:28 devstack sudo[115035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:28 devstack sudo[115036]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7e5b7faa-b6d1-48ac-9d04-69039d2c1d76 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.7fc7293b-1e2f-4376-b398-dab6c7367d81" returned: 0 in 0.322s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:28 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-7e5b7faa-b6d1-48ac-9d04-69039d2c1d76 tempest-ProjectMemberTests-1426758417 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.7fc7293b-1e2f-4376-b398-dab6c7367d81 is being set with open permissions: ugo+rw Aug 27 03:58:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7e5b7faa-b6d1-48ac-9d04-69039d2c1d76 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.7fc7293b-1e2f-4376-b398-dab6c7367d81 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:28 devstack sudo[115046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.7fc7293b-1e2f-4376-b398-dab6c7367d81 Aug 27 03:58:28 devstack sudo[115046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:28 devstack sudo[115035]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32388b57-98e7-4ec9-b1e2-88f77298ac5a tempest-VolumeDependencyTests-465344188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.307ff5f9-948c-429f-833c-a54dc955f352" returned: 0 in 0.420s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:28 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-32388b57-98e7-4ec9-b1e2-88f77298ac5a tempest-VolumeDependencyTests-465344188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0657a07a-074d-41e2-a4a8-50bbe981b77d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:58:28 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48b00a2-45e3-4e25-8eb3-a8fcc6031457]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32388b57-98e7-4ec9-b1e2-88f77298ac5a tempest-VolumeDependencyTests-465344188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:28 devstack sudo[115048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d Aug 27 03:58:28 devstack sudo[115048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:28 devstack sudo[115046]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7e5b7faa-b6d1-48ac-9d04-69039d2c1d76 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.7fc7293b-1e2f-4376-b398-dab6c7367d81" returned: 0 in 0.281s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7e5b7faa-b6d1-48ac-9d04-69039d2c1d76 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:29 devstack sudo[115051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.info Aug 27 03:58:29 devstack sudo[115051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:29 devstack sudo[115048]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32388b57-98e7-4ec9-b1e2-88f77298ac5a tempest-VolumeDependencyTests-465344188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d" returned: 0 in 0.581s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:29 devstack sudo[115051]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32388b57-98e7-4ec9-b1e2-88f77298ac5a tempest-VolumeDependencyTests-465344188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.307ff5f9-948c-429f-833c-a54dc955f352 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7e5b7faa-b6d1-48ac-9d04-69039d2c1d76 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.info" returned: 0 in 0.359s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:29 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-7e5b7faa-b6d1-48ac-9d04-69039d2c1d76 tempest-ProjectMemberTests-1426758417 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.info is being set with open permissions: ugo+rw Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7e5b7faa-b6d1-48ac-9d04-69039d2c1d76 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:29 devstack sudo[115057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.307ff5f9-948c-429f-833c-a54dc955f352 Aug 27 03:58:29 devstack sudo[115057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:29 devstack sudo[115058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.info Aug 27 03:58:29 devstack sudo[115058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:29 devstack sudo[115058]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7e5b7faa-b6d1-48ac-9d04-69039d2c1d76 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.info" returned: 0 in 0.270s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7e5b7faa-b6d1-48ac-9d04-69039d2c1d76 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.176s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.320s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-829745029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd153b15-bfb3-4755-9fef-f27df4f3c029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c91680c73ffe4d6e9be91c4d3a789e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:27Z,use_quota=True,user_id='5ebe86d5bb784b1ead724efed91e0b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Creating volume dd153b15-bfb3-4755-9fef-f27df4f3c029 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:58:29 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:29 devstack sudo[115065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029 1073741824 Aug 27 03:58:29 devstack sudo[115065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:29 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-7e5b7faa-b6d1-48ac-9d04-69039d2c1d76 tempest-ProjectMemberTests-1426758417 None] Create snapshot completed successfully Aug 27 03:58:29 devstack sudo[115057]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32388b57-98e7-4ec9-b1e2-88f77298ac5a tempest-VolumeDependencyTests-465344188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.307ff5f9-948c-429f-833c-a54dc955f352" returned: 0 in 0.385s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32388b57-98e7-4ec9-b1e2-88f77298ac5a tempest-VolumeDependencyTests-465344188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.307ff5f9-948c-429f-833c-a54dc955f352 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:29 devstack sudo[115067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.307ff5f9-948c-429f-833c-a54dc955f352 Aug 27 03:58:29 devstack sudo[115067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d34d6034-8d50-4080-9d78-3c215677380e tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-7fc7293b-1e2f-4376-b398-dab6c7367d81-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d34d6034-8d50-4080-9d78-3c215677380e tempest-ProjectMemberTests-1426758417 None] Lock "cinder-7fc7293b-1e2f-4376-b398-dab6c7367d81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d34d6034-8d50-4080-9d78-3c215677380e tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d34d6034-8d50-4080-9d78-3c215677380e tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d34d6034-8d50-4080-9d78-3c215677380e tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-7fc7293b-1e2f-4376-b398-dab6c7367d81" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d34d6034-8d50-4080-9d78-3c215677380e tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-7fc7293b-1e2f-4376-b398-dab6c7367d81" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-d34d6034-8d50-4080-9d78-3c215677380e tempest-ProjectMemberTests-1426758417 None] Deleting offline snapshot 7fc7293b-1e2f-4376-b398-dab6c7367d81 of volume 3eb4a7e3-7293-4cdc-ac98-54ee61f1157a {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-d34d6034-8d50-4080-9d78-3c215677380e tempest-ProjectMemberTests-1426758417 None] snapshot_file for this snap is: volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.7fc7293b-1e2f-4376-b398-dab6c7367d81 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e5884d-cbf5-4ed8-b7bd-f384905cc1cb]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d34d6034-8d50-4080-9d78-3c215677380e tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.7fc7293b-1e2f-4376-b398-dab6c7367d81 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:30 devstack sudo[115067]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32388b57-98e7-4ec9-b1e2-88f77298ac5a tempest-VolumeDependencyTests-465344188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d.307ff5f9-948c-429f-833c-a54dc955f352" returned: 0 in 0.305s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-32388b57-98e7-4ec9-b1e2-88f77298ac5a tempest-VolumeDependencyTests-465344188 None] Lock "cinder-quobyte-307ff5f9-948c-429f-833c-a54dc955f352" released by "_delete_snapshot" :: held 1.819s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-32388b57-98e7-4ec9-b1e2-88f77298ac5a tempest-VolumeDependencyTests-465344188 None] Lock "cinder-quobyte-0657a07a-074d-41e2-a4a8-50bbe981b77d" released by "delete_snapshot" :: held 1.852s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:30 devstack sudo[115073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.7fc7293b-1e2f-4376-b398-dab6c7367d81 Aug 27 03:58:30 devstack sudo[115073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:30 devstack sudo[115065]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029 1073741824" returned: 0 in 0.529s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-32388b57-98e7-4ec9-b1e2-88f77298ac5a tempest-VolumeDependencyTests-465344188 None] Created reservations ['727bc22b-68a2-4853-8d3d-3fb11c0a830a', '3e205c30-7026-45a8-a519-05e44014e274', '68734684-ec5c-4b85-bd3c-36cb49298926', '71ba6809-60c8-4f84-88d3-0165e089ba40'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:30 devstack sudo[115075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029 Aug 27 03:58:30 devstack sudo[115075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:30 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-32388b57-98e7-4ec9-b1e2-88f77298ac5a tempest-VolumeDependencyTests-465344188 None] Delete snapshot completed successfully. Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-32388b57-98e7-4ec9-b1e2-88f77298ac5a tempest-VolumeDependencyTests-465344188 None] Lock "cinder-307ff5f9-948c-429f-833c-a54dc955f352-delete_snapshot" released by "delete_snapshot" :: held 2.077s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6462358a-00d4-43f2-9102-0ced8259b0d0 tempest-VolumeDependencyTests-465344188 None] Acquiring lock "cinder-0657a07a-074d-41e2-a4a8-50bbe981b77d-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6462358a-00d4-43f2-9102-0ced8259b0d0 tempest-VolumeDependencyTests-465344188 None] Lock "cinder-0657a07a-074d-41e2-a4a8-50bbe981b77d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:30 devstack sudo[115073]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6462358a-00d4-43f2-9102-0ced8259b0d0 tempest-VolumeDependencyTests-465344188 None] Acquiring lock "cinder-quobyte-0657a07a-074d-41e2-a4a8-50bbe981b77d" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d34d6034-8d50-4080-9d78-3c215677380e tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.7fc7293b-1e2f-4376-b398-dab6c7367d81" returned: 0 in 0.524s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-d34d6034-8d50-4080-9d78-3c215677380e tempest-ProjectMemberTests-1426758417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6462358a-00d4-43f2-9102-0ced8259b0d0 tempest-VolumeDependencyTests-465344188 None] Lock "cinder-quobyte-0657a07a-074d-41e2-a4a8-50bbe981b77d" acquired by "delete_volume" :: waited 0.035s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:30 devstack sudo[115075]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68f88ae-59d4-4d2d-a776-16eed5198c4f]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d34d6034-8d50-4080-9d78-3c215677380e tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029" returned: 0 in 0.372s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e29e32-9905-4445-aa7e-57ce1f74f40c]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6462358a-00d4-43f2-9102-0ced8259b0d0 tempest-VolumeDependencyTests-465344188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de06a25-2648-4b3e-b467-100be744cc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd153b15-bfb3-4755-9fef-f27df4f3c029', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f467162d-8642-49c8-9498-29a77b0dc365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:30 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Volume volume-dd153b15-bfb3-4755-9fef-f27df4f3c029 (dd153b15-bfb3-4755-9fef-f27df4f3c029): created successfully Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f467162d-8642-49c8-9498-29a77b0dc365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Flow 'volume_create_manager' (4452d19c-919b-4df6-92aa-08739e6abf3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:30 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e2e5998b-3616-4343-b37d-1b0e1ee22eb9 tempest-ProjectReaderTests-806833313 None] Created volume successfully. Aug 27 03:58:30 devstack sudo[115082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d Aug 27 03:58:30 devstack sudo[115082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:30 devstack sudo[115081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a Aug 27 03:58:30 devstack sudo[115081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:31 devstack sudo[115081]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d34d6034-8d50-4080-9d78-3c215677380e tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a" returned: 0 in 0.404s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d34d6034-8d50-4080-9d78-3c215677380e tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.7fc7293b-1e2f-4376-b398-dab6c7367d81 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:31 devstack sudo[115082]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6462358a-00d4-43f2-9102-0ced8259b0d0 tempest-VolumeDependencyTests-465344188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d" returned: 0 in 0.397s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6462358a-00d4-43f2-9102-0ced8259b0d0 tempest-VolumeDependencyTests-465344188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:31 devstack sudo[115091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.7fc7293b-1e2f-4376-b398-dab6c7367d81 Aug 27 03:58:31 devstack sudo[115091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:31 devstack sudo[115092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d Aug 27 03:58:31 devstack sudo[115092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:31 devstack sudo[115092]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6462358a-00d4-43f2-9102-0ced8259b0d0 tempest-VolumeDependencyTests-465344188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-0657a07a-074d-41e2-a4a8-50bbe981b77d" returned: 0 in 0.267s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6462358a-00d4-43f2-9102-0ced8259b0d0 tempest-VolumeDependencyTests-465344188 None] Lock "cinder-quobyte-0657a07a-074d-41e2-a4a8-50bbe981b77d" released by "delete_volume" :: held 0.740s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-6462358a-00d4-43f2-9102-0ced8259b0d0 tempest-VolumeDependencyTests-465344188 None] Created reservations ['60092dc7-3068-437b-b3f7-d55cfebc5e6b', 'e05fe4d6-c453-421c-bf19-1bcc07a837bb', 'c4d29c8e-d2c8-48b0-97bb-8c08e8574808', '94012ba2-6228-4b01-996c-dcac927cf0f1'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:31 devstack sudo[115091]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d34d6034-8d50-4080-9d78-3c215677380e tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.7fc7293b-1e2f-4376-b398-dab6c7367d81" returned: 0 in 0.411s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d34d6034-8d50-4080-9d78-3c215677380e tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.7fc7293b-1e2f-4376-b398-dab6c7367d81 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:31 devstack sudo[115100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.7fc7293b-1e2f-4376-b398-dab6c7367d81 Aug 27 03:58:31 devstack sudo[115100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6462358a-00d4-43f2-9102-0ced8259b0d0 tempest-VolumeDependencyTests-465344188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6462358a-00d4-43f2-9102-0ced8259b0d0 tempest-VolumeDependencyTests-465344188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-6462358a-00d4-43f2-9102-0ced8259b0d0 tempest-VolumeDependencyTests-465344188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-6462358a-00d4-43f2-9102-0ced8259b0d0 tempest-VolumeDependencyTests-465344188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6462358a-00d4-43f2-9102-0ced8259b0d0 tempest-VolumeDependencyTests-465344188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6462358a-00d4-43f2-9102-0ced8259b0d0 tempest-VolumeDependencyTests-465344188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:31 devstack sudo[115102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:58:31 devstack sudo[115102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-65dea5a7-2d24-4884-ae77-c925aed7feb7 tempest-VolumeDependencyTests-465344188 None] Acquiring lock "cinder-b2a2c54a-a768-430f-bba8-d9eb2ac510b2-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-65dea5a7-2d24-4884-ae77-c925aed7feb7 tempest-VolumeDependencyTests-465344188 None] Lock "cinder-b2a2c54a-a768-430f-bba8-d9eb2ac510b2-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2d901a2b-629e-41cd-a8ae-da3125ef7f14 tempest-ProjectReaderTests-806833313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2d901a2b-629e-41cd-a8ae-da3125ef7f14 tempest-ProjectReaderTests-806833313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-2d901a2b-629e-41cd-a8ae-da3125ef7f14 tempest-ProjectReaderTests-806833313 None] Creating offline snapshot 1c4c26c7-bf9b-4c8e-b7da-db397d407edb of volume dd153b15-bfb3-4755-9fef-f27df4f3c029 {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-65dea5a7-2d24-4884-ae77-c925aed7feb7 tempest-VolumeDependencyTests-465344188 None] Acquiring lock "cinder-quobyte-b2a2c54a-a768-430f-bba8-d9eb2ac510b2" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:31 devstack sudo[115100]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-65dea5a7-2d24-4884-ae77-c925aed7feb7 tempest-VolumeDependencyTests-465344188 None] Lock "cinder-quobyte-b2a2c54a-a768-430f-bba8-d9eb2ac510b2" acquired by "delete_volume" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a81b5c-efa8-4806-8272-c7f37d9a443a]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2d901a2b-629e-41cd-a8ae-da3125ef7f14 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d34d6034-8d50-4080-9d78-3c215677380e tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a.7fc7293b-1e2f-4376-b398-dab6c7367d81" returned: 0 in 0.424s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9d2770-8217-4ea6-a75d-3a98b44fa343]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-65dea5a7-2d24-4884-ae77-c925aed7feb7 tempest-VolumeDependencyTests-465344188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2a2c54a-a768-430f-bba8-d9eb2ac510b2 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:31 devstack sudo[115102]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6462358a-00d4-43f2-9102-0ced8259b0d0 tempest-VolumeDependencyTests-465344188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.424s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-6462358a-00d4-43f2-9102-0ced8259b0d0 tempest-VolumeDependencyTests-465344188 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d34d6034-8d50-4080-9d78-3c215677380e tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-7fc7293b-1e2f-4376-b398-dab6c7367d81" released by "_delete_snapshot" :: held 1.938s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:31 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-6462358a-00d4-43f2-9102-0ced8259b0d0 tempest-VolumeDependencyTests-465344188 None] Deleted volume successfully. Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d34d6034-8d50-4080-9d78-3c215677380e tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a" released by "delete_snapshot" :: held 1.983s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6462358a-00d4-43f2-9102-0ced8259b0d0 tempest-VolumeDependencyTests-465344188 None] Lock "cinder-0657a07a-074d-41e2-a4a8-50bbe981b77d-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:32 devstack sudo[115106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029 Aug 27 03:58:32 devstack sudo[115106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-d34d6034-8d50-4080-9d78-3c215677380e tempest-ProjectMemberTests-1426758417 None] Created reservations ['99b44a1d-4844-4496-97d1-7eb9c086dc89', '3db78c30-69f2-4ac9-9bc9-4e37f4b10d5c', 'c262f71b-1fa6-4dc8-9cba-9129ce046473', '2a21a148-fef7-4e03-93f3-1c2b9946d323'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:32 devstack sudo[115107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2a2c54a-a768-430f-bba8-d9eb2ac510b2 Aug 27 03:58:32 devstack sudo[115107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:32 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d34d6034-8d50-4080-9d78-3c215677380e tempest-ProjectMemberTests-1426758417 None] Delete snapshot completed successfully. Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d34d6034-8d50-4080-9d78-3c215677380e tempest-ProjectMemberTests-1426758417 None] Lock "cinder-7fc7293b-1e2f-4376-b398-dab6c7367d81-delete_snapshot" released by "delete_snapshot" :: held 2.163s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-efb7a691-b68e-471a-a683-b86a07cbe40c tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-efb7a691-b68e-471a-a683-b86a07cbe40c tempest-ProjectMemberTests-1426758417 None] Lock "cinder-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-efb7a691-b68e-471a-a683-b86a07cbe40c tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-efb7a691-b68e-471a-a683-b86a07cbe40c tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a" acquired by "delete_volume" :: waited 0.033s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d8924b-c279-4920-b452-82af11342ddd]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-efb7a691-b68e-471a-a683-b86a07cbe40c tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:32 devstack sudo[115106]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2d901a2b-629e-41cd-a8ae-da3125ef7f14 tempest-ProjectReaderTests-806833313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029" returned: 0 in 0.560s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2d901a2b-629e-41cd-a8ae-da3125ef7f14 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.1c4c26c7-bf9b-4c8e-b7da-db397d407edb 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:32 devstack sudo[115116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.1c4c26c7-bf9b-4c8e-b7da-db397d407edb 1G Aug 27 03:58:32 devstack sudo[115116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:32 devstack sudo[115107]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:32 devstack sudo[115113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-65dea5a7-2d24-4884-ae77-c925aed7feb7 tempest-VolumeDependencyTests-465344188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2a2c54a-a768-430f-bba8-d9eb2ac510b2" returned: 0 in 0.609s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:32 devstack sudo[115113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-65dea5a7-2d24-4884-ae77-c925aed7feb7 tempest-VolumeDependencyTests-465344188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2a2c54a-a768-430f-bba8-d9eb2ac510b2 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:32 devstack sudo[115120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2a2c54a-a768-430f-bba8-d9eb2ac510b2 Aug 27 03:58:32 devstack sudo[115120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:32 devstack sudo[115120]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-65dea5a7-2d24-4884-ae77-c925aed7feb7 tempest-VolumeDependencyTests-465344188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b2a2c54a-a768-430f-bba8-d9eb2ac510b2" returned: 0 in 0.257s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-65dea5a7-2d24-4884-ae77-c925aed7feb7 tempest-VolumeDependencyTests-465344188 None] Lock "cinder-quobyte-b2a2c54a-a768-430f-bba8-d9eb2ac510b2" released by "delete_volume" :: held 0.952s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-65dea5a7-2d24-4884-ae77-c925aed7feb7 tempest-VolumeDependencyTests-465344188 None] Created reservations ['625358ac-c2ef-4071-ade1-e9bb2c5d69f0', '0212336d-6eea-46f1-b9b9-be1edee4010d', '0e9f8795-7c5d-48f4-bedb-bc7cf5437254', '6fb7506d-364d-421c-be89-4174edc52769'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:32 devstack sudo[115113]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-efb7a691-b68e-471a-a683-b86a07cbe40c tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a" returned: 0 in 0.514s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-efb7a691-b68e-471a-a683-b86a07cbe40c tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:32 devstack sudo[115130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a Aug 27 03:58:32 devstack sudo[115130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-65dea5a7-2d24-4884-ae77-c925aed7feb7 tempest-VolumeDependencyTests-465344188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-65dea5a7-2d24-4884-ae77-c925aed7feb7 tempest-VolumeDependencyTests-465344188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-65dea5a7-2d24-4884-ae77-c925aed7feb7 tempest-VolumeDependencyTests-465344188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-65dea5a7-2d24-4884-ae77-c925aed7feb7 tempest-VolumeDependencyTests-465344188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-65dea5a7-2d24-4884-ae77-c925aed7feb7 tempest-VolumeDependencyTests-465344188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-65dea5a7-2d24-4884-ae77-c925aed7feb7 tempest-VolumeDependencyTests-465344188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:32 devstack sudo[115116]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2d901a2b-629e-41cd-a8ae-da3125ef7f14 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.1c4c26c7-bf9b-4c8e-b7da-db397d407edb 1G" returned: 0 in 0.578s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2d901a2b-629e-41cd-a8ae-da3125ef7f14 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd153b15-bfb3-4755-9fef-f27df4f3c029 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.1c4c26c7-bf9b-4c8e-b7da-db397d407edb {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:32 devstack sudo[115132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:58:32 devstack sudo[115132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:33 devstack sudo[115133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd153b15-bfb3-4755-9fef-f27df4f3c029 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.1c4c26c7-bf9b-4c8e-b7da-db397d407edb Aug 27 03:58:33 devstack sudo[115133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:33 devstack sudo[115130]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-efb7a691-b68e-471a-a683-b86a07cbe40c tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a" returned: 0 in 0.337s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:33 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-efb7a691-b68e-471a-a683-b86a07cbe40c tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a" released by "delete_volume" :: held 0.964s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:33 devstack sudo[115132]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-65dea5a7-2d24-4884-ae77-c925aed7feb7 tempest-VolumeDependencyTests-465344188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.319s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:33 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-65dea5a7-2d24-4884-ae77-c925aed7feb7 tempest-VolumeDependencyTests-465344188 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:58:33 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-65dea5a7-2d24-4884-ae77-c925aed7feb7 tempest-VolumeDependencyTests-465344188 None] Deleted volume successfully. Aug 27 03:58:33 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-65dea5a7-2d24-4884-ae77-c925aed7feb7 tempest-VolumeDependencyTests-465344188 None] Lock "cinder-b2a2c54a-a768-430f-bba8-d9eb2ac510b2-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:33 devstack sudo[115133]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:33 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-efb7a691-b68e-471a-a683-b86a07cbe40c tempest-ProjectMemberTests-1426758417 None] Created reservations ['da112be4-ed53-44c7-8554-84ce10efa188', '95f97662-7454-4abb-8391-2b75769b7c42', 'ebe8019a-08c6-41e1-8748-285f388f968f', 'e13c07ee-fc15-4f53-baba-796def6f1d08'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2d901a2b-629e-41cd-a8ae-da3125ef7f14 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd153b15-bfb3-4755-9fef-f27df4f3c029 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.1c4c26c7-bf9b-4c8e-b7da-db397d407edb" returned: 0 in 0.377s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:33 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-2d901a2b-629e-41cd-a8ae-da3125ef7f14 tempest-ProjectReaderTests-806833313 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.1c4c26c7-bf9b-4c8e-b7da-db397d407edb is being set with open permissions: ugo+rw Aug 27 03:58:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2d901a2b-629e-41cd-a8ae-da3125ef7f14 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.1c4c26c7-bf9b-4c8e-b7da-db397d407edb {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:33 devstack sudo[115142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.1c4c26c7-bf9b-4c8e-b7da-db397d407edb Aug 27 03:58:33 devstack sudo[115142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-efb7a691-b68e-471a-a683-b86a07cbe40c tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-efb7a691-b68e-471a-a683-b86a07cbe40c tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-efb7a691-b68e-471a-a683-b86a07cbe40c tempest-ProjectMemberTests-1426758417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-efb7a691-b68e-471a-a683-b86a07cbe40c tempest-ProjectMemberTests-1426758417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-efb7a691-b68e-471a-a683-b86a07cbe40c tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-efb7a691-b68e-471a-a683-b86a07cbe40c tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:33 devstack sudo[115145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:58:33 devstack sudo[115145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:33 devstack sudo[115142]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2d901a2b-629e-41cd-a8ae-da3125ef7f14 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.1c4c26c7-bf9b-4c8e-b7da-db397d407edb" returned: 0 in 0.264s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2d901a2b-629e-41cd-a8ae-da3125ef7f14 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:33 devstack sudo[115148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.info Aug 27 03:58:33 devstack sudo[115148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:33 devstack sudo[115145]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-efb7a691-b68e-471a-a683-b86a07cbe40c tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.264s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:33 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-efb7a691-b68e-471a-a683-b86a07cbe40c tempest-ProjectMemberTests-1426758417 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:58:33 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-efb7a691-b68e-471a-a683-b86a07cbe40c tempest-ProjectMemberTests-1426758417 None] Deleted volume successfully. Aug 27 03:58:33 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-efb7a691-b68e-471a-a683-b86a07cbe40c tempest-ProjectMemberTests-1426758417 None] Lock "cinder-3eb4a7e3-7293-4cdc-ac98-54ee61f1157a-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:33 devstack sudo[115148]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2d901a2b-629e-41cd-a8ae-da3125ef7f14 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.info" returned: 0 in 0.322s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:33 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-2d901a2b-629e-41cd-a8ae-da3125ef7f14 tempest-ProjectReaderTests-806833313 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.info is being set with open permissions: ugo+rw Aug 27 03:58:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2d901a2b-629e-41cd-a8ae-da3125ef7f14 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:33 devstack sudo[115152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.info Aug 27 03:58:33 devstack sudo[115152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:34 devstack sudo[115152]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2d901a2b-629e-41cd-a8ae-da3125ef7f14 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.info" returned: 0 in 0.272s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2d901a2b-629e-41cd-a8ae-da3125ef7f14 tempest-ProjectReaderTests-806833313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.509s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:34 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-2d901a2b-629e-41cd-a8ae-da3125ef7f14 tempest-ProjectReaderTests-806833313 None] Create snapshot completed successfully Aug 27 03:58:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2adf8b0d-4ca2-46b5-a0a0-29b4e5d27301 tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-1c4c26c7-bf9b-4c8e-b7da-db397d407edb-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2adf8b0d-4ca2-46b5-a0a0-29b4e5d27301 tempest-ProjectReaderTests-806833313 None] Lock "cinder-1c4c26c7-bf9b-4c8e-b7da-db397d407edb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2adf8b0d-4ca2-46b5-a0a0-29b4e5d27301 tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-quobyte-dd153b15-bfb3-4755-9fef-f27df4f3c029" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Flow 'volume_create_manager' (78e16527-effe-489b-9982-3ef0e7a2ee86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf6b46f3-d5be-4013-a8e0-b620233d7be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2adf8b0d-4ca2-46b5-a0a0-29b4e5d27301 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-dd153b15-bfb3-4755-9fef-f27df4f3c029" acquired by "delete_snapshot" :: waited 0.057s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2adf8b0d-4ca2-46b5-a0a0-29b4e5d27301 tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-quobyte-1c4c26c7-bf9b-4c8e-b7da-db397d407edb" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf6b46f3-d5be-4013-a8e0-b620233d7be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-871780519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=268ad1f0-bd25-465b-93c5-5f9fc5ac700d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8658e7bcb5964a65a4672729d843a24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:35Z,use_quota=True,user_id='d1b1c78558e94e16b33cfaf2594e5ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1992caf2-3ad2-4f40-907d-655a4ee773b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1992caf2-3ad2-4f40-907d-655a4ee773b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7255d64d-1184-4d37-b202-42f8ec8057ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7255d64d-1184-4d37-b202-42f8ec8057ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '268ad1f0-bd25-465b-93c5-5f9fc5ac700d', 'volume_name': 'volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (474fb8c4-37e9-41cb-9323-78b844df7973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (474fb8c4-37e9-41cb-9323-78b844df7973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85c669c8-1328-4530-95ed-e432d86e6c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:35 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Volume 268ad1f0-bd25-465b-93c5-5f9fc5ac700d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d', 'volume_size': 1} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-871780519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=268ad1f0-bd25-465b-93c5-5f9fc5ac700d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8658e7bcb5964a65a4672729d843a24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:35Z,use_quota=True,user_id='d1b1c78558e94e16b33cfaf2594e5ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Creating volume 268ad1f0-bd25-465b-93c5-5f9fc5ac700d {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:58:35 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2adf8b0d-4ca2-46b5-a0a0-29b4e5d27301 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-1c4c26c7-bf9b-4c8e-b7da-db397d407edb" acquired by "_delete_snapshot" :: waited 0.079s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:35 devstack sudo[115155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d 1073741824 Aug 27 03:58:35 devstack sudo[115155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-2adf8b0d-4ca2-46b5-a0a0-29b4e5d27301 tempest-ProjectReaderTests-806833313 None] Deleting offline snapshot 1c4c26c7-bf9b-4c8e-b7da-db397d407edb of volume dd153b15-bfb3-4755-9fef-f27df4f3c029 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-2adf8b0d-4ca2-46b5-a0a0-29b4e5d27301 tempest-ProjectReaderTests-806833313 None] snapshot_file for this snap is: volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.1c4c26c7-bf9b-4c8e-b7da-db397d407edb {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[119c2935-1202-494c-b78a-3f64d68fe263]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2adf8b0d-4ca2-46b5-a0a0-29b4e5d27301 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.1c4c26c7-bf9b-4c8e-b7da-db397d407edb {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:35 devstack sudo[115157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.1c4c26c7-bf9b-4c8e-b7da-db397d407edb Aug 27 03:58:35 devstack sudo[115157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:35 devstack sudo[115155]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d 1073741824" returned: 0 in 0.463s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:35 devstack sudo[115157]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2adf8b0d-4ca2-46b5-a0a0-29b4e5d27301 tempest-ProjectReaderTests-806833313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.1c4c26c7-bf9b-4c8e-b7da-db397d407edb" returned: 0 in 0.443s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-2adf8b0d-4ca2-46b5-a0a0-29b4e5d27301 tempest-ProjectReaderTests-806833313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd153b15-bfb3-4755-9fef-f27df4f3c029(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:58:35 devstack sudo[115167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d Aug 27 03:58:35 devstack sudo[115167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c695d6-0ec1-43bf-bb77-9ea7313f3829]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2adf8b0d-4ca2-46b5-a0a0-29b4e5d27301 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:35 devstack sudo[115169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029 Aug 27 03:58:35 devstack sudo[115169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:35 devstack sudo[115167]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d" returned: 0 in 0.239s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85c669c8-1328-4530-95ed-e432d86e6c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18db574f-4d5b-4254-af64-ccaa4fbdd881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:35 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Volume volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d (268ad1f0-bd25-465b-93c5-5f9fc5ac700d): created successfully Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18db574f-4d5b-4254-af64-ccaa4fbdd881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Flow 'volume_create_manager' (78e16527-effe-489b-9982-3ef0e7a2ee86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:35 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-32862816-1a73-4ae5-9942-4688fd9cdf5c tempest-ProjectMemberTests-1426758417 None] Created volume successfully. Aug 27 03:58:36 devstack sudo[115169]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2adf8b0d-4ca2-46b5-a0a0-29b4e5d27301 tempest-ProjectReaderTests-806833313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029" returned: 0 in 0.423s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2adf8b0d-4ca2-46b5-a0a0-29b4e5d27301 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.1c4c26c7-bf9b-4c8e-b7da-db397d407edb {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:36 devstack sudo[115175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.1c4c26c7-bf9b-4c8e-b7da-db397d407edb Aug 27 03:58:36 devstack sudo[115175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:36 devstack sudo[115175]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2adf8b0d-4ca2-46b5-a0a0-29b4e5d27301 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.1c4c26c7-bf9b-4c8e-b7da-db397d407edb" returned: 0 in 0.366s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2adf8b0d-4ca2-46b5-a0a0-29b4e5d27301 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.1c4c26c7-bf9b-4c8e-b7da-db397d407edb {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:36 devstack sudo[115180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.1c4c26c7-bf9b-4c8e-b7da-db397d407edb Aug 27 03:58:36 devstack sudo[115180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:36 devstack sudo[115180]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2adf8b0d-4ca2-46b5-a0a0-29b4e5d27301 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029.1c4c26c7-bf9b-4c8e-b7da-db397d407edb" returned: 0 in 0.261s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:36 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2adf8b0d-4ca2-46b5-a0a0-29b4e5d27301 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-1c4c26c7-bf9b-4c8e-b7da-db397d407edb" released by "_delete_snapshot" :: held 1.608s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:36 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2adf8b0d-4ca2-46b5-a0a0-29b4e5d27301 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-dd153b15-bfb3-4755-9fef-f27df4f3c029" released by "delete_snapshot" :: held 1.695s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:36 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-2adf8b0d-4ca2-46b5-a0a0-29b4e5d27301 tempest-ProjectReaderTests-806833313 None] Created reservations ['0d613e4b-11f9-47dd-8ef2-763c01a4cf96', '89c59ea4-f501-4bd4-8716-08cc5a49d2cd', '88011871-2480-4e11-a11c-b49cd7b23696', '78833fd0-99e0-4be2-889e-42fa03827792'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:36 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-2adf8b0d-4ca2-46b5-a0a0-29b4e5d27301 tempest-ProjectReaderTests-806833313 None] Delete snapshot completed successfully. Aug 27 03:58:36 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2adf8b0d-4ca2-46b5-a0a0-29b4e5d27301 tempest-ProjectReaderTests-806833313 None] Lock "cinder-1c4c26c7-bf9b-4c8e-b7da-db397d407edb-delete_snapshot" released by "delete_snapshot" :: held 1.873s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f0cbd1c8-7448-4511-b08e-25c4593388e2 tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-dd153b15-bfb3-4755-9fef-f27df4f3c029-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f0cbd1c8-7448-4511-b08e-25c4593388e2 tempest-ProjectReaderTests-806833313 None] Lock "cinder-dd153b15-bfb3-4755-9fef-f27df4f3c029-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f0cbd1c8-7448-4511-b08e-25c4593388e2 tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-quobyte-dd153b15-bfb3-4755-9fef-f27df4f3c029" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-45a3a471-d3f4-43be-80e7-042c5bf52637 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-45a3a471-d3f4-43be-80e7-042c5bf52637 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-45a3a471-d3f4-43be-80e7-042c5bf52637 tempest-ProjectMemberTests-1426758417 None] Creating offline snapshot e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc of volume 268ad1f0-bd25-465b-93c5-5f9fc5ac700d {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:58:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f0cbd1c8-7448-4511-b08e-25c4593388e2 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-dd153b15-bfb3-4755-9fef-f27df4f3c029" acquired by "delete_volume" :: waited 0.040s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:37 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[13589f5e-6a2d-4590-814b-8422d8e76c05]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-45a3a471-d3f4-43be-80e7-042c5bf52637 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:37 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4533b2-9a97-464e-a2f1-6238fda989c1]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f0cbd1c8-7448-4511-b08e-25c4593388e2 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:37 devstack sudo[115183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d Aug 27 03:58:37 devstack sudo[115183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:37 devstack sudo[115184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029 Aug 27 03:58:37 devstack sudo[115184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:37 devstack sudo[115183]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-45a3a471-d3f4-43be-80e7-042c5bf52637 tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d" returned: 0 in 0.415s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-45a3a471-d3f4-43be-80e7-042c5bf52637 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:37 devstack sudo[115184]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f0cbd1c8-7448-4511-b08e-25c4593388e2 tempest-ProjectReaderTests-806833313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029" returned: 0 in 0.418s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f0cbd1c8-7448-4511-b08e-25c4593388e2 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:37 devstack sudo[115194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc 1G Aug 27 03:58:37 devstack sudo[115194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:37 devstack sudo[115195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029 Aug 27 03:58:37 devstack sudo[115195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:38 devstack sudo[115195]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f0cbd1c8-7448-4511-b08e-25c4593388e2 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-dd153b15-bfb3-4755-9fef-f27df4f3c029" returned: 0 in 0.254s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:38 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f0cbd1c8-7448-4511-b08e-25c4593388e2 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-dd153b15-bfb3-4755-9fef-f27df4f3c029" released by "delete_volume" :: held 0.739s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:38 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-f0cbd1c8-7448-4511-b08e-25c4593388e2 tempest-ProjectReaderTests-806833313 None] Created reservations ['d036832f-4315-41b4-b920-0ecc4cad3146', 'ab467ea6-bcf9-4ad4-af39-8c12372fe2c8', '5ec0de67-0a66-493d-aa2a-0e842185c141', '988e2e0b-79c1-4118-b236-e4b7c35b782b'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f0cbd1c8-7448-4511-b08e-25c4593388e2 tempest-ProjectReaderTests-806833313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f0cbd1c8-7448-4511-b08e-25c4593388e2 tempest-ProjectReaderTests-806833313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:38 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f0cbd1c8-7448-4511-b08e-25c4593388e2 tempest-ProjectReaderTests-806833313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:38 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f0cbd1c8-7448-4511-b08e-25c4593388e2 tempest-ProjectReaderTests-806833313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f0cbd1c8-7448-4511-b08e-25c4593388e2 tempest-ProjectReaderTests-806833313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f0cbd1c8-7448-4511-b08e-25c4593388e2 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:38 devstack sudo[115203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:58:38 devstack sudo[115203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:38 devstack sudo[115194]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-45a3a471-d3f4-43be-80e7-042c5bf52637 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc 1G" returned: 0 in 0.458s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-45a3a471-d3f4-43be-80e7-042c5bf52637 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:38 devstack sudo[115205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc Aug 27 03:58:38 devstack sudo[115205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:38 devstack sudo[115203]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f0cbd1c8-7448-4511-b08e-25c4593388e2 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.309s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:38 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-f0cbd1c8-7448-4511-b08e-25c4593388e2 tempest-ProjectReaderTests-806833313 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:58:38 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f0cbd1c8-7448-4511-b08e-25c4593388e2 tempest-ProjectReaderTests-806833313 None] Deleted volume successfully. Aug 27 03:58:38 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f0cbd1c8-7448-4511-b08e-25c4593388e2 tempest-ProjectReaderTests-806833313 None] Lock "cinder-dd153b15-bfb3-4755-9fef-f27df4f3c029-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:38 devstack sudo[115205]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-45a3a471-d3f4-43be-80e7-042c5bf52637 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc" returned: 0 in 0.368s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:38 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-45a3a471-d3f4-43be-80e7-042c5bf52637 tempest-ProjectMemberTests-1426758417 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc is being set with open permissions: ugo+rw Aug 27 03:58:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-45a3a471-d3f4-43be-80e7-042c5bf52637 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:38 devstack sudo[115211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc Aug 27 03:58:38 devstack sudo[115211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:38 devstack sudo[115211]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-45a3a471-d3f4-43be-80e7-042c5bf52637 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc" returned: 0 in 0.269s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:38 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-45a3a471-d3f4-43be-80e7-042c5bf52637 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:38 devstack sudo[115214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.info Aug 27 03:58:38 devstack sudo[115214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:38 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:58:38 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Flow 'volume_create_manager' (ef2eb929-388e-4d1b-b133-91e2a3f84365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:38 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d8a39d-0075-4080-bde1-7e39c4f749f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:38 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d8a39d-0075-4080-bde1-7e39c4f749f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1460663382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d812607a-f977-4780-bfbd-75a3b512a1ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c91680c73ffe4d6e9be91c4d3a789e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:39Z,use_quota=True,user_id='5ebe86d5bb784b1ead724efed91e0b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:38 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe48a370-6ef1-4fd5-8af1-77ac17744d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:38 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe48a370-6ef1-4fd5-8af1-77ac17744d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:39 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05cd2201-6213-4179-8607-f8721277e6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:39 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05cd2201-6213-4179-8607-f8721277e6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd812607a-f977-4780-bfbd-75a3b512a1ef', 'volume_name': 'volume-d812607a-f977-4780-bfbd-75a3b512a1ef', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:39 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd747ff5-3d45-4700-9c07-20982db0cc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:39 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd747ff5-3d45-4700-9c07-20982db0cc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:39 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ee4ea8-7e77-4c27-93d8-04e0e178afad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:39 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Volume d812607a-f977-4780-bfbd-75a3b512a1ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d812607a-f977-4780-bfbd-75a3b512a1ef', 'volume_size': 1} Aug 27 03:58:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:39 devstack sudo[115214]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-45a3a471-d3f4-43be-80e7-042c5bf52637 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.info" returned: 0 in 0.273s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:39 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-45a3a471-d3f4-43be-80e7-042c5bf52637 tempest-ProjectMemberTests-1426758417 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.info is being set with open permissions: ugo+rw Aug 27 03:58:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-45a3a471-d3f4-43be-80e7-042c5bf52637 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:39 devstack sudo[115217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.info Aug 27 03:58:39 devstack sudo[115217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:39 devstack sudo[115217]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-45a3a471-d3f4-43be-80e7-042c5bf52637 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.info" returned: 0 in 0.267s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-45a3a471-d3f4-43be-80e7-042c5bf52637 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.179s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.435s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:39 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1460663382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d812607a-f977-4780-bfbd-75a3b512a1ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c91680c73ffe4d6e9be91c4d3a789e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:39Z,use_quota=True,user_id='5ebe86d5bb784b1ead724efed91e0b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:58:39 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Creating volume d812607a-f977-4780-bfbd-75a3b512a1ef {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:58:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:39 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:39 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:39 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:58:39 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:58:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:39 devstack sudo[115220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef 1073741824 Aug 27 03:58:39 devstack sudo[115220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:39 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-45a3a471-d3f4-43be-80e7-042c5bf52637 tempest-ProjectMemberTests-1426758417 None] Create snapshot completed successfully Aug 27 03:58:39 devstack sudo[115220]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef 1073741824" returned: 0 in 0.475s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:39 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:40 devstack sudo[115226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef Aug 27 03:58:40 devstack sudo[115226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:40 devstack sudo[115226]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef" returned: 0 in 0.269s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:40 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:58:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:40 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ee4ea8-7e77-4c27-93d8-04e0e178afad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d812607a-f977-4780-bfbd-75a3b512a1ef', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:40 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2684a322-46f6-4780-8e20-dd763b9d5147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:40 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Volume volume-d812607a-f977-4780-bfbd-75a3b512a1ef (d812607a-f977-4780-bfbd-75a3b512a1ef): created successfully Aug 27 03:58:40 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2684a322-46f6-4780-8e20-dd763b9d5147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:40 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Flow 'volume_create_manager' (ef2eb929-388e-4d1b-b133-91e2a3f84365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:40 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-daeb4429-393e-4668-9ad4-948cf1df2c95 tempest-ProjectReaderTests-806833313 None] Created volume successfully. Aug 27 03:58:40 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8dad9c93-d732-49d6-801c-6a31cc746007 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:40 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8dad9c93-d732-49d6-801c-6a31cc746007 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:40 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8dad9c93-d732-49d6-801c-6a31cc746007 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-268ad1f0-bd25-465b-93c5-5f9fc5ac700d" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:40 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8dad9c93-d732-49d6-801c-6a31cc746007 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-268ad1f0-bd25-465b-93c5-5f9fc5ac700d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:40 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8dad9c93-d732-49d6-801c-6a31cc746007 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:40 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8dad9c93-d732-49d6-801c-6a31cc746007 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:40 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-8dad9c93-d732-49d6-801c-6a31cc746007 tempest-ProjectMemberTests-1426758417 None] Deleting offline snapshot e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc of volume 268ad1f0-bd25-465b-93c5-5f9fc5ac700d {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:58:40 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-8dad9c93-d732-49d6-801c-6a31cc746007 tempest-ProjectMemberTests-1426758417 None] snapshot_file for this snap is: volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:58:40 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[92afaa51-2824-46c1-8808-b4f30c1e95db]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8dad9c93-d732-49d6-801c-6a31cc746007 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:40 devstack sudo[115229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc Aug 27 03:58:40 devstack sudo[115229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:40 devstack sudo[115229]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8dad9c93-d732-49d6-801c-6a31cc746007 tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc" returned: 0 in 0.397s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:40 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-8dad9c93-d732-49d6-801c-6a31cc746007 tempest-ProjectMemberTests-1426758417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:58:40 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[42708983-10f6-4c52-b332-54971709c834]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:40 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8dad9c93-d732-49d6-801c-6a31cc746007 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:41 devstack sudo[115235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d Aug 27 03:58:41 devstack sudo[115235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d9713168-ee27-4d84-a78c-7a40342b1a13 tempest-ProjectReaderTests-806833313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d9713168-ee27-4d84-a78c-7a40342b1a13 tempest-ProjectReaderTests-806833313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:41 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-d9713168-ee27-4d84-a78c-7a40342b1a13 tempest-ProjectReaderTests-806833313 None] Creating offline snapshot b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe of volume d812607a-f977-4780-bfbd-75a3b512a1ef {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:58:41 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81c93f9-343c-4d94-bad6-6a119fde7181]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d9713168-ee27-4d84-a78c-7a40342b1a13 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:41 devstack sudo[115237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef Aug 27 03:58:41 devstack sudo[115237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:41 devstack sudo[115235]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8dad9c93-d732-49d6-801c-6a31cc746007 tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d" returned: 0 in 0.416s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8dad9c93-d732-49d6-801c-6a31cc746007 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:41 devstack sudo[115243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc Aug 27 03:58:41 devstack sudo[115243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:41 devstack sudo[115237]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d9713168-ee27-4d84-a78c-7a40342b1a13 tempest-ProjectReaderTests-806833313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef" returned: 0 in 0.419s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d9713168-ee27-4d84-a78c-7a40342b1a13 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:41 devstack sudo[115252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe 1G Aug 27 03:58:41 devstack sudo[115252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:41 devstack sudo[115243]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8dad9c93-d732-49d6-801c-6a31cc746007 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc" returned: 0 in 0.396s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:41 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8dad9c93-d732-49d6-801c-6a31cc746007 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:41 devstack sudo[115255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc Aug 27 03:58:41 devstack sudo[115255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:42 devstack sudo[115255]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8dad9c93-d732-49d6-801c-6a31cc746007 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d.e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc" returned: 0 in 0.289s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:42 devstack sudo[115252]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d9713168-ee27-4d84-a78c-7a40342b1a13 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe 1G" returned: 0 in 0.443s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d9713168-ee27-4d84-a78c-7a40342b1a13 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d812607a-f977-4780-bfbd-75a3b512a1ef -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8dad9c93-d732-49d6-801c-6a31cc746007 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc" released by "_delete_snapshot" :: held 1.610s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8dad9c93-d732-49d6-801c-6a31cc746007 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-268ad1f0-bd25-465b-93c5-5f9fc5ac700d" released by "delete_snapshot" :: held 1.639s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:42 devstack sudo[115261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d812607a-f977-4780-bfbd-75a3b512a1ef -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe Aug 27 03:58:42 devstack sudo[115261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:42 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-8dad9c93-d732-49d6-801c-6a31cc746007 tempest-ProjectMemberTests-1426758417 None] Created reservations ['f69ea944-7500-4e04-b404-cb6c16853f7b', '7097e142-d49a-4c68-9141-adc31747d666', '40514f40-5df8-414d-9ad3-d2be9b0648c6', '1cb1d50b-2cb6-4ab9-9049-38430a4cbe93'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:42 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-8dad9c93-d732-49d6-801c-6a31cc746007 tempest-ProjectMemberTests-1426758417 None] Delete snapshot completed successfully. Aug 27 03:58:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8dad9c93-d732-49d6-801c-6a31cc746007 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-e0ea3cb6-0f21-49f4-9f12-4d71a2145ccc-delete_snapshot" released by "delete_snapshot" :: held 1.800s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:42 devstack sudo[115261]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d9713168-ee27-4d84-a78c-7a40342b1a13 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d812607a-f977-4780-bfbd-75a3b512a1ef -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe" returned: 0 in 0.325s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:42 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-d9713168-ee27-4d84-a78c-7a40342b1a13 tempest-ProjectReaderTests-806833313 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe is being set with open permissions: ugo+rw Aug 27 03:58:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d9713168-ee27-4d84-a78c-7a40342b1a13 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:42 devstack sudo[115266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe Aug 27 03:58:42 devstack sudo[115266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5eab0040-3995-46c5-a816-b8d14f2df11f tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-268ad1f0-bd25-465b-93c5-5f9fc5ac700d-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5eab0040-3995-46c5-a816-b8d14f2df11f tempest-ProjectMemberTests-1426758417 None] Lock "cinder-268ad1f0-bd25-465b-93c5-5f9fc5ac700d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:42 devstack sudo[115266]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5eab0040-3995-46c5-a816-b8d14f2df11f tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-268ad1f0-bd25-465b-93c5-5f9fc5ac700d" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d9713168-ee27-4d84-a78c-7a40342b1a13 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe" returned: 0 in 0.270s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:42 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5eab0040-3995-46c5-a816-b8d14f2df11f tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-268ad1f0-bd25-465b-93c5-5f9fc5ac700d" acquired by "delete_volume" :: waited 0.023s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d9713168-ee27-4d84-a78c-7a40342b1a13 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:42 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afa16a1-6c90-412c-ab75-335b9c95a956]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5eab0040-3995-46c5-a816-b8d14f2df11f tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:42 devstack sudo[115269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.info Aug 27 03:58:42 devstack sudo[115269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:42 devstack sudo[115270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d Aug 27 03:58:42 devstack sudo[115270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:42 devstack sudo[115269]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:42 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d9713168-ee27-4d84-a78c-7a40342b1a13 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.info" returned: 0 in 0.258s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:43 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-d9713168-ee27-4d84-a78c-7a40342b1a13 tempest-ProjectReaderTests-806833313 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.info is being set with open permissions: ugo+rw Aug 27 03:58:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d9713168-ee27-4d84-a78c-7a40342b1a13 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:43 devstack sudo[115274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.info Aug 27 03:58:43 devstack sudo[115274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:43 devstack sudo[115270]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5eab0040-3995-46c5-a816-b8d14f2df11f tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d" returned: 0 in 0.437s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5eab0040-3995-46c5-a816-b8d14f2df11f tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:43 devstack sudo[115279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d Aug 27 03:58:43 devstack sudo[115279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:43 devstack sudo[115274]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d9713168-ee27-4d84-a78c-7a40342b1a13 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.info" returned: 0 in 0.277s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d9713168-ee27-4d84-a78c-7a40342b1a13 tempest-ProjectReaderTests-806833313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.124s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:43 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d9713168-ee27-4d84-a78c-7a40342b1a13 tempest-ProjectReaderTests-806833313 None] Create snapshot completed successfully Aug 27 03:58:43 devstack sudo[115279]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5eab0040-3995-46c5-a816-b8d14f2df11f tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-268ad1f0-bd25-465b-93c5-5f9fc5ac700d" returned: 0 in 0.276s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5eab0040-3995-46c5-a816-b8d14f2df11f tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-268ad1f0-bd25-465b-93c5-5f9fc5ac700d" released by "delete_volume" :: held 0.786s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:43 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-5eab0040-3995-46c5-a816-b8d14f2df11f tempest-ProjectMemberTests-1426758417 None] Created reservations ['7cdcc92f-75cc-40e8-a111-81d913f753ee', 'c2decfe7-c887-45df-b2f2-e63158ed6662', '2053b410-9bce-426b-8845-ea3b74473696', '922c9a8e-7d4b-4ed6-a3ae-de305b63864e'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5eab0040-3995-46c5-a816-b8d14f2df11f tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5eab0040-3995-46c5-a816-b8d14f2df11f tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5eab0040-3995-46c5-a816-b8d14f2df11f tempest-ProjectMemberTests-1426758417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:43 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5eab0040-3995-46c5-a816-b8d14f2df11f tempest-ProjectMemberTests-1426758417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5eab0040-3995-46c5-a816-b8d14f2df11f tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5eab0040-3995-46c5-a816-b8d14f2df11f tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:43 devstack sudo[115284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:58:43 devstack sudo[115284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:43 devstack sudo[115284]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:43 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5eab0040-3995-46c5-a816-b8d14f2df11f tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.258s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:43 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-5eab0040-3995-46c5-a816-b8d14f2df11f tempest-ProjectMemberTests-1426758417 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:58:43 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-5eab0040-3995-46c5-a816-b8d14f2df11f tempest-ProjectMemberTests-1426758417 None] Deleted volume successfully. Aug 27 03:58:43 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5eab0040-3995-46c5-a816-b8d14f2df11f tempest-ProjectMemberTests-1426758417 None] Lock "cinder-268ad1f0-bd25-465b-93c5-5f9fc5ac700d-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Flow 'volume_create_manager' (0deb2964-4fde-4a6a-8e7f-6f831e628f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60f23f6-cfe9-4d91-b50e-db0959c92b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60f23f6-cfe9-4d91-b50e-db0959c92b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511913133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fccf3258-780b-4d28-84b2-5ede40a35e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8658e7bcb5964a65a4672729d843a24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:44Z,use_quota=True,user_id='d1b1c78558e94e16b33cfaf2594e5ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f7c366a-b7d3-4ccb-b134-e76ffcf7dab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f7c366a-b7d3-4ccb-b134-e76ffcf7dab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (808785b1-25be-4a06-b67a-de9c17ffd7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (808785b1-25be-4a06-b67a-de9c17ffd7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fccf3258-780b-4d28-84b2-5ede40a35e11', 'volume_name': 'volume-fccf3258-780b-4d28-84b2-5ede40a35e11', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da8e0a4-2956-4486-86bf-84932618861c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da8e0a4-2956-4486-86bf-84932618861c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45dc9466-feb0-47be-845f-ec69c66c4b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:44 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Volume fccf3258-780b-4d28-84b2-5ede40a35e11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fccf3258-780b-4d28-84b2-5ede40a35e11', 'volume_size': 1} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511913133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fccf3258-780b-4d28-84b2-5ede40a35e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8658e7bcb5964a65a4672729d843a24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:44Z,use_quota=True,user_id='d1b1c78558e94e16b33cfaf2594e5ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Creating volume fccf3258-780b-4d28-84b2-5ede40a35e11 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:58:44 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2dacecd2-d80c-429d-9389-f2043a416a30 tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:44 devstack sudo[115287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11 1073741824 Aug 27 03:58:44 devstack sudo[115287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2dacecd2-d80c-429d-9389-f2043a416a30 tempest-ProjectReaderTests-806833313 None] Lock "cinder-b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2dacecd2-d80c-429d-9389-f2043a416a30 tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-quobyte-d812607a-f977-4780-bfbd-75a3b512a1ef" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2dacecd2-d80c-429d-9389-f2043a416a30 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-d812607a-f977-4780-bfbd-75a3b512a1ef" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2dacecd2-d80c-429d-9389-f2043a416a30 tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-quobyte-b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2dacecd2-d80c-429d-9389-f2043a416a30 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-2dacecd2-d80c-429d-9389-f2043a416a30 tempest-ProjectReaderTests-806833313 None] Deleting offline snapshot b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe of volume d812607a-f977-4780-bfbd-75a3b512a1ef {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-2dacecd2-d80c-429d-9389-f2043a416a30 tempest-ProjectReaderTests-806833313 None] snapshot_file for this snap is: volume-d812607a-f977-4780-bfbd-75a3b512a1ef.b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ce8ba4-a4ff-4975-bff7-3ca2a2400971]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2dacecd2-d80c-429d-9389-f2043a416a30 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:44 devstack sudo[115289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe Aug 27 03:58:44 devstack sudo[115289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:44 devstack sudo[115287]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11 1073741824" returned: 0 in 0.502s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:44 devstack sudo[115289]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2dacecd2-d80c-429d-9389-f2043a416a30 tempest-ProjectReaderTests-806833313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe" returned: 0 in 0.435s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-2dacecd2-d80c-429d-9389-f2043a416a30 tempest-ProjectReaderTests-806833313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d812607a-f977-4780-bfbd-75a3b512a1ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:58:44 devstack sudo[115297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11 Aug 27 03:58:44 devstack sudo[115297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[9995dd7a-698a-4abd-9cff-9a50754d7852]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:44 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2dacecd2-d80c-429d-9389-f2043a416a30 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:45 devstack sudo[115299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef Aug 27 03:58:45 devstack sudo[115299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:45 devstack sudo[115297]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11" returned: 0 in 0.256s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:45 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:58:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:45 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45dc9466-feb0-47be-845f-ec69c66c4b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fccf3258-780b-4d28-84b2-5ede40a35e11', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:45 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (159c4883-b572-4164-ace1-7de7f53898b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:45 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Volume volume-fccf3258-780b-4d28-84b2-5ede40a35e11 (fccf3258-780b-4d28-84b2-5ede40a35e11): created successfully Aug 27 03:58:45 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (159c4883-b572-4164-ace1-7de7f53898b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:45 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Flow 'volume_create_manager' (0deb2964-4fde-4a6a-8e7f-6f831e628f45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:45 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-163a63a1-98e8-4c36-a556-42de4969ff81 tempest-ProjectMemberTests-1426758417 None] Created volume successfully. Aug 27 03:58:45 devstack sudo[115299]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2dacecd2-d80c-429d-9389-f2043a416a30 tempest-ProjectReaderTests-806833313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef" returned: 0 in 0.408s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2dacecd2-d80c-429d-9389-f2043a416a30 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:45 devstack sudo[115305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe Aug 27 03:58:45 devstack sudo[115305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:45 devstack sudo[115305]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2dacecd2-d80c-429d-9389-f2043a416a30 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe" returned: 0 in 0.348s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2dacecd2-d80c-429d-9389-f2043a416a30 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:45 devstack sudo[115310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe Aug 27 03:58:45 devstack sudo[115310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:45 devstack sudo[115310]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:45 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2dacecd2-d80c-429d-9389-f2043a416a30 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef.b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe" returned: 0 in 0.238s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:45 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2dacecd2-d80c-429d-9389-f2043a416a30 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe" released by "_delete_snapshot" :: held 1.532s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:46 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2dacecd2-d80c-429d-9389-f2043a416a30 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-d812607a-f977-4780-bfbd-75a3b512a1ef" released by "delete_snapshot" :: held 1.567s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:46 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-2dacecd2-d80c-429d-9389-f2043a416a30 tempest-ProjectReaderTests-806833313 None] Created reservations ['650679ea-009d-445f-a546-eecd7342e5a5', '63a71eb7-e6a5-4f0f-a1c2-fa654d0c92e3', 'b0e44c63-db0b-46e0-8ce7-3df2dd692dd3', 'bd6d53f2-b0e7-46f8-8d05-07dbcde65918'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:46 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-2dacecd2-d80c-429d-9389-f2043a416a30 tempest-ProjectReaderTests-806833313 None] Delete snapshot completed successfully. Aug 27 03:58:46 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-2dacecd2-d80c-429d-9389-f2043a416a30 tempest-ProjectReaderTests-806833313 None] Lock "cinder-b1cd8a0b-4bdd-46fa-9231-c41b889f8bfe-delete_snapshot" released by "delete_snapshot" :: held 1.713s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ae9d2a2c-cb7f-4f6e-b97f-420066dff36a tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ae9d2a2c-cb7f-4f6e-b97f-420066dff36a tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:46 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-ae9d2a2c-cb7f-4f6e-b97f-420066dff36a tempest-ProjectMemberTests-1426758417 None] Creating offline snapshot 30aa44bb-ae99-43d9-afb2-034db0d7287f of volume fccf3258-780b-4d28-84b2-5ede40a35e11 {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:58:46 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f192c8-f87c-45c0-ac4b-eb59ad63e39d]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ae9d2a2c-cb7f-4f6e-b97f-420066dff36a tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:46 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-04f48660-8050-4c3e-8eeb-fe20708595c7 tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-d812607a-f977-4780-bfbd-75a3b512a1ef-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:46 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-04f48660-8050-4c3e-8eeb-fe20708595c7 tempest-ProjectReaderTests-806833313 None] Lock "cinder-d812607a-f977-4780-bfbd-75a3b512a1ef-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:46 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-04f48660-8050-4c3e-8eeb-fe20708595c7 tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-quobyte-d812607a-f977-4780-bfbd-75a3b512a1ef" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:46 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-04f48660-8050-4c3e-8eeb-fe20708595c7 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-d812607a-f977-4780-bfbd-75a3b512a1ef" acquired by "delete_volume" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:46 devstack sudo[115313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11 Aug 27 03:58:46 devstack sudo[115313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:46 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4ee04a-5e80-4cd2-99f9-8595e4fdd2ad]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-04f48660-8050-4c3e-8eeb-fe20708595c7 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:46 devstack sudo[115315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef Aug 27 03:58:46 devstack sudo[115315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:46 devstack sudo[115313]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ae9d2a2c-cb7f-4f6e-b97f-420066dff36a tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11" returned: 0 in 0.429s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:46 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ae9d2a2c-cb7f-4f6e-b97f-420066dff36a tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.30aa44bb-ae99-43d9-afb2-034db0d7287f 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:47 devstack sudo[115321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.30aa44bb-ae99-43d9-afb2-034db0d7287f 1G Aug 27 03:58:47 devstack sudo[115321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:47 devstack sudo[115315]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-04f48660-8050-4c3e-8eeb-fe20708595c7 tempest-ProjectReaderTests-806833313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef" returned: 0 in 0.424s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-04f48660-8050-4c3e-8eeb-fe20708595c7 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:47 devstack sudo[115326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef Aug 27 03:58:47 devstack sudo[115326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:47 devstack sudo[115326]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-04f48660-8050-4c3e-8eeb-fe20708595c7 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-d812607a-f977-4780-bfbd-75a3b512a1ef" returned: 0 in 0.247s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:47 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-04f48660-8050-4c3e-8eeb-fe20708595c7 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-d812607a-f977-4780-bfbd-75a3b512a1ef" released by "delete_volume" :: held 0.750s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:47 devstack sudo[115321]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ae9d2a2c-cb7f-4f6e-b97f-420066dff36a tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.30aa44bb-ae99-43d9-afb2-034db0d7287f 1G" returned: 0 in 0.442s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ae9d2a2c-cb7f-4f6e-b97f-420066dff36a tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fccf3258-780b-4d28-84b2-5ede40a35e11 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.30aa44bb-ae99-43d9-afb2-034db0d7287f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:47 devstack sudo[115333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fccf3258-780b-4d28-84b2-5ede40a35e11 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.30aa44bb-ae99-43d9-afb2-034db0d7287f Aug 27 03:58:47 devstack sudo[115333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:47 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-04f48660-8050-4c3e-8eeb-fe20708595c7 tempest-ProjectReaderTests-806833313 None] Created reservations ['46796785-bc6b-478a-b470-760ae7288594', '9253be06-9f8f-4511-a9fb-0ac96edd7c2e', '1df66286-7231-421b-b72f-c0cbf68d4aed', 'a1c22b6d-695e-4037-90b9-a52eb475ea9e'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-04f48660-8050-4c3e-8eeb-fe20708595c7 tempest-ProjectReaderTests-806833313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-04f48660-8050-4c3e-8eeb-fe20708595c7 tempest-ProjectReaderTests-806833313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:47 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-04f48660-8050-4c3e-8eeb-fe20708595c7 tempest-ProjectReaderTests-806833313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:47 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-04f48660-8050-4c3e-8eeb-fe20708595c7 tempest-ProjectReaderTests-806833313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-04f48660-8050-4c3e-8eeb-fe20708595c7 tempest-ProjectReaderTests-806833313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-04f48660-8050-4c3e-8eeb-fe20708595c7 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:47 devstack sudo[115335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:58:47 devstack sudo[115335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:47 devstack sudo[115333]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ae9d2a2c-cb7f-4f6e-b97f-420066dff36a tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fccf3258-780b-4d28-84b2-5ede40a35e11 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.30aa44bb-ae99-43d9-afb2-034db0d7287f" returned: 0 in 0.325s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:47 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-ae9d2a2c-cb7f-4f6e-b97f-420066dff36a tempest-ProjectMemberTests-1426758417 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.30aa44bb-ae99-43d9-afb2-034db0d7287f is being set with open permissions: ugo+rw Aug 27 03:58:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ae9d2a2c-cb7f-4f6e-b97f-420066dff36a tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.30aa44bb-ae99-43d9-afb2-034db0d7287f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:47 devstack sudo[115340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.30aa44bb-ae99-43d9-afb2-034db0d7287f Aug 27 03:58:47 devstack sudo[115340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:47 devstack sudo[115335]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-04f48660-8050-4c3e-8eeb-fe20708595c7 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.261s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:47 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-04f48660-8050-4c3e-8eeb-fe20708595c7 tempest-ProjectReaderTests-806833313 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:58:47 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-04f48660-8050-4c3e-8eeb-fe20708595c7 tempest-ProjectReaderTests-806833313 None] Deleted volume successfully. Aug 27 03:58:47 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-04f48660-8050-4c3e-8eeb-fe20708595c7 tempest-ProjectReaderTests-806833313 None] Lock "cinder-d812607a-f977-4780-bfbd-75a3b512a1ef-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:47 devstack sudo[115340]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:47 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ae9d2a2c-cb7f-4f6e-b97f-420066dff36a tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.30aa44bb-ae99-43d9-afb2-034db0d7287f" returned: 0 in 0.253s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ae9d2a2c-cb7f-4f6e-b97f-420066dff36a tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:48 devstack sudo[115344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.info Aug 27 03:58:48 devstack sudo[115344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Flow 'volume_create_manager' (a6619753-cbd5-4551-a02a-2404cb974c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a82ee8f-fece-4b53-b35e-947899b0423d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a82ee8f-fece-4b53-b35e-947899b0423d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1442693809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2498e296-161e-436a-80f3-829b15690bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c91680c73ffe4d6e9be91c4d3a789e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:48Z,use_quota=True,user_id='5ebe86d5bb784b1ead724efed91e0b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (948ff9f8-0846-41d0-8f64-881191c886bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (948ff9f8-0846-41d0-8f64-881191c886bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26800341-2eb5-4889-943c-90538a8776cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26800341-2eb5-4889-943c-90538a8776cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2498e296-161e-436a-80f3-829b15690bcd', 'volume_name': 'volume-2498e296-161e-436a-80f3-829b15690bcd', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253e1ff5-2227-4191-9a5e-9a91e6efe6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253e1ff5-2227-4191-9a5e-9a91e6efe6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f842a6-8a95-4c41-b357-8b173f93dff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:48 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Volume 2498e296-161e-436a-80f3-829b15690bcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2498e296-161e-436a-80f3-829b15690bcd', 'volume_size': 1} Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:48 devstack sudo[115344]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ae9d2a2c-cb7f-4f6e-b97f-420066dff36a tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.info" returned: 0 in 0.279s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:48 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-ae9d2a2c-cb7f-4f6e-b97f-420066dff36a tempest-ProjectMemberTests-1426758417 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.info is being set with open permissions: ugo+rw Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ae9d2a2c-cb7f-4f6e-b97f-420066dff36a tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:48 devstack sudo[115347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.info Aug 27 03:58:48 devstack sudo[115347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:48 devstack sudo[115347]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ae9d2a2c-cb7f-4f6e-b97f-420066dff36a tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.info" returned: 0 in 0.274s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ae9d2a2c-cb7f-4f6e-b97f-420066dff36a tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.098s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.313s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1442693809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2498e296-161e-436a-80f3-829b15690bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c91680c73ffe4d6e9be91c4d3a789e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:48Z,use_quota=True,user_id='5ebe86d5bb784b1ead724efed91e0b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Creating volume 2498e296-161e-436a-80f3-829b15690bcd {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:58:48 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:58:48 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:48 devstack sudo[115350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd 1073741824 Aug 27 03:58:48 devstack sudo[115350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:48 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-ae9d2a2c-cb7f-4f6e-b97f-420066dff36a tempest-ProjectMemberTests-1426758417 None] Create snapshot completed successfully Aug 27 03:58:49 devstack sudo[115350]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd 1073741824" returned: 0 in 0.454s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:49 devstack sudo[115356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd Aug 27 03:58:49 devstack sudo[115356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:49 devstack sudo[115356]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd" returned: 0 in 0.258s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:49 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:58:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f842a6-8a95-4c41-b357-8b173f93dff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2498e296-161e-436a-80f3-829b15690bcd', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbbd1630-d543-440c-b837-7f6e6484ae49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:49 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Volume volume-2498e296-161e-436a-80f3-829b15690bcd (2498e296-161e-436a-80f3-829b15690bcd): created successfully Aug 27 03:58:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbbd1630-d543-440c-b837-7f6e6484ae49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:49 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Flow 'volume_create_manager' (a6619753-cbd5-4551-a02a-2404cb974c39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:49 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-3ed8ce01-52e2-4d41-b178-247819b05c47 tempest-ProjectReaderTests-806833313 None] Created volume successfully. Aug 27 03:58:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8e3ed243-18c5-4229-bf9b-59eca60d5a9d tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-30aa44bb-ae99-43d9-afb2-034db0d7287f-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8e3ed243-18c5-4229-bf9b-59eca60d5a9d tempest-ProjectMemberTests-1426758417 None] Lock "cinder-30aa44bb-ae99-43d9-afb2-034db0d7287f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8e3ed243-18c5-4229-bf9b-59eca60d5a9d tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-fccf3258-780b-4d28-84b2-5ede40a35e11" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8e3ed243-18c5-4229-bf9b-59eca60d5a9d tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-fccf3258-780b-4d28-84b2-5ede40a35e11" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8e3ed243-18c5-4229-bf9b-59eca60d5a9d tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-30aa44bb-ae99-43d9-afb2-034db0d7287f" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:49 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8e3ed243-18c5-4229-bf9b-59eca60d5a9d tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-30aa44bb-ae99-43d9-afb2-034db0d7287f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:49 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-8e3ed243-18c5-4229-bf9b-59eca60d5a9d tempest-ProjectMemberTests-1426758417 None] Deleting offline snapshot 30aa44bb-ae99-43d9-afb2-034db0d7287f of volume fccf3258-780b-4d28-84b2-5ede40a35e11 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:58:49 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-8e3ed243-18c5-4229-bf9b-59eca60d5a9d tempest-ProjectMemberTests-1426758417 None] snapshot_file for this snap is: volume-fccf3258-780b-4d28-84b2-5ede40a35e11.30aa44bb-ae99-43d9-afb2-034db0d7287f {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:58:49 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dae57e0-c1a9-4aa8-91bf-6813cab5e520]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:49 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8e3ed243-18c5-4229-bf9b-59eca60d5a9d tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.30aa44bb-ae99-43d9-afb2-034db0d7287f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:49 devstack sudo[115359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.30aa44bb-ae99-43d9-afb2-034db0d7287f Aug 27 03:58:49 devstack sudo[115359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:50 devstack sudo[115359]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8e3ed243-18c5-4229-bf9b-59eca60d5a9d tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.30aa44bb-ae99-43d9-afb2-034db0d7287f" returned: 0 in 0.345s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-8e3ed243-18c5-4229-bf9b-59eca60d5a9d tempest-ProjectMemberTests-1426758417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fccf3258-780b-4d28-84b2-5ede40a35e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:58:50 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8420bd-46dc-48b6-8e2f-426e3dbb079b]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8e3ed243-18c5-4229-bf9b-59eca60d5a9d tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:50 devstack sudo[115364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11 Aug 27 03:58:50 devstack sudo[115364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:50 devstack sudo[115364]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8e3ed243-18c5-4229-bf9b-59eca60d5a9d tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11" returned: 0 in 0.386s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8e3ed243-18c5-4229-bf9b-59eca60d5a9d tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.30aa44bb-ae99-43d9-afb2-034db0d7287f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:50 devstack sudo[115369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.30aa44bb-ae99-43d9-afb2-034db0d7287f Aug 27 03:58:50 devstack sudo[115369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a557040b-8f3b-46bf-85c7-2a8a753f036e tempest-ProjectReaderTests-806833313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a557040b-8f3b-46bf-85c7-2a8a753f036e tempest-ProjectReaderTests-806833313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:50 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-a557040b-8f3b-46bf-85c7-2a8a753f036e tempest-ProjectReaderTests-806833313 None] Creating offline snapshot b9d61172-a4f7-416b-a92f-ab0afcf389d5 of volume 2498e296-161e-436a-80f3-829b15690bcd {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:58:50 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d8ade3-e397-4939-aa00-a53747ee1d93]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a557040b-8f3b-46bf-85c7-2a8a753f036e tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:50 devstack sudo[115373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd Aug 27 03:58:50 devstack sudo[115373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:50 devstack sudo[115369]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8e3ed243-18c5-4229-bf9b-59eca60d5a9d tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.30aa44bb-ae99-43d9-afb2-034db0d7287f" returned: 0 in 0.413s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:50 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8e3ed243-18c5-4229-bf9b-59eca60d5a9d tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.30aa44bb-ae99-43d9-afb2-034db0d7287f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:50 devstack sudo[115377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.30aa44bb-ae99-43d9-afb2-034db0d7287f Aug 27 03:58:50 devstack sudo[115377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:51 devstack sudo[115373]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a557040b-8f3b-46bf-85c7-2a8a753f036e tempest-ProjectReaderTests-806833313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd" returned: 0 in 0.400s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a557040b-8f3b-46bf-85c7-2a8a753f036e tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.b9d61172-a4f7-416b-a92f-ab0afcf389d5 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:51 devstack sudo[115377]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-8e3ed243-18c5-4229-bf9b-59eca60d5a9d tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11.30aa44bb-ae99-43d9-afb2-034db0d7287f" returned: 0 in 0.259s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:51 devstack sudo[115383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.b9d61172-a4f7-416b-a92f-ab0afcf389d5 1G Aug 27 03:58:51 devstack sudo[115383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8e3ed243-18c5-4229-bf9b-59eca60d5a9d tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-30aa44bb-ae99-43d9-afb2-034db0d7287f" released by "_delete_snapshot" :: held 1.490s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8e3ed243-18c5-4229-bf9b-59eca60d5a9d tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-fccf3258-780b-4d28-84b2-5ede40a35e11" released by "delete_snapshot" :: held 1.518s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:51 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-8e3ed243-18c5-4229-bf9b-59eca60d5a9d tempest-ProjectMemberTests-1426758417 None] Created reservations ['e7701921-7d71-45ca-946c-89a2d4c42c24', '7a819747-c7aa-4810-ba3a-b90e4ccbe513', '93a79dd0-d9b5-49cc-b15c-21ed2f181c4b', '5c1ad872-b945-44e9-8e73-36ec15351537'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:51 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-8e3ed243-18c5-4229-bf9b-59eca60d5a9d tempest-ProjectMemberTests-1426758417 None] Delete snapshot completed successfully. Aug 27 03:58:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-8e3ed243-18c5-4229-bf9b-59eca60d5a9d tempest-ProjectMemberTests-1426758417 None] Lock "cinder-30aa44bb-ae99-43d9-afb2-034db0d7287f-delete_snapshot" released by "delete_snapshot" :: held 1.653s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:51 devstack sudo[115383]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a557040b-8f3b-46bf-85c7-2a8a753f036e tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.b9d61172-a4f7-416b-a92f-ab0afcf389d5 1G" returned: 0 in 0.387s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a557040b-8f3b-46bf-85c7-2a8a753f036e tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2498e296-161e-436a-80f3-829b15690bcd -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.b9d61172-a4f7-416b-a92f-ab0afcf389d5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:51 devstack sudo[115389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2498e296-161e-436a-80f3-829b15690bcd -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.b9d61172-a4f7-416b-a92f-ab0afcf389d5 Aug 27 03:58:51 devstack sudo[115389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-90abfafe-9892-4677-b25d-bb9d258733cc tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-fccf3258-780b-4d28-84b2-5ede40a35e11-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:51 devstack sudo[115389]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a557040b-8f3b-46bf-85c7-2a8a753f036e tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2498e296-161e-436a-80f3-829b15690bcd -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.b9d61172-a4f7-416b-a92f-ab0afcf389d5" returned: 0 in 0.297s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:51 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-a557040b-8f3b-46bf-85c7-2a8a753f036e tempest-ProjectReaderTests-806833313 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.b9d61172-a4f7-416b-a92f-ab0afcf389d5 is being set with open permissions: ugo+rw Aug 27 03:58:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a557040b-8f3b-46bf-85c7-2a8a753f036e tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.b9d61172-a4f7-416b-a92f-ab0afcf389d5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-90abfafe-9892-4677-b25d-bb9d258733cc tempest-ProjectMemberTests-1426758417 None] Lock "cinder-fccf3258-780b-4d28-84b2-5ede40a35e11-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:51 devstack sudo[115394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.b9d61172-a4f7-416b-a92f-ab0afcf389d5 Aug 27 03:58:51 devstack sudo[115394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-90abfafe-9892-4677-b25d-bb9d258733cc tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-fccf3258-780b-4d28-84b2-5ede40a35e11" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:51 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-90abfafe-9892-4677-b25d-bb9d258733cc tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-fccf3258-780b-4d28-84b2-5ede40a35e11" acquired by "delete_volume" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:51 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[814b6028-3403-4ecf-90c6-f2d34dae2bb9]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:51 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-90abfafe-9892-4677-b25d-bb9d258733cc tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:52 devstack sudo[115396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11 Aug 27 03:58:52 devstack sudo[115396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:52 devstack sudo[115394]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a557040b-8f3b-46bf-85c7-2a8a753f036e tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.b9d61172-a4f7-416b-a92f-ab0afcf389d5" returned: 0 in 0.263s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a557040b-8f3b-46bf-85c7-2a8a753f036e tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:52 devstack sudo[115399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.info Aug 27 03:58:52 devstack sudo[115399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:52 devstack sudo[115396]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-90abfafe-9892-4677-b25d-bb9d258733cc tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11" returned: 0 in 0.406s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-90abfafe-9892-4677-b25d-bb9d258733cc tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:52 devstack sudo[115405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11 Aug 27 03:58:52 devstack sudo[115405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:52 devstack sudo[115399]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a557040b-8f3b-46bf-85c7-2a8a753f036e tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.info" returned: 0 in 0.292s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:52 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-a557040b-8f3b-46bf-85c7-2a8a753f036e tempest-ProjectReaderTests-806833313 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.info is being set with open permissions: ugo+rw Aug 27 03:58:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a557040b-8f3b-46bf-85c7-2a8a753f036e tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:52 devstack sudo[115407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.info Aug 27 03:58:52 devstack sudo[115407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:52 devstack sudo[115405]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-90abfafe-9892-4677-b25d-bb9d258733cc tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fccf3258-780b-4d28-84b2-5ede40a35e11" returned: 0 in 0.247s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:52 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-90abfafe-9892-4677-b25d-bb9d258733cc tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-fccf3258-780b-4d28-84b2-5ede40a35e11" released by "delete_volume" :: held 0.730s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:52 devstack sudo[115407]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:52 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-90abfafe-9892-4677-b25d-bb9d258733cc tempest-ProjectMemberTests-1426758417 None] Created reservations ['78af561f-c152-4063-8f29-29420f83a339', 'd60ae0bf-576f-447c-955a-89559cf3334b', 'b2bc215e-b4be-43c2-91ac-3d0b77cda0ed', 'e46d81ae-0a48-4470-be05-8842179a247e'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-a557040b-8f3b-46bf-85c7-2a8a753f036e tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.info" returned: 0 in 0.275s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-a557040b-8f3b-46bf-85c7-2a8a753f036e tempest-ProjectReaderTests-806833313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:52 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-a557040b-8f3b-46bf-85c7-2a8a753f036e tempest-ProjectReaderTests-806833313 None] Create snapshot completed successfully Aug 27 03:58:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-90abfafe-9892-4677-b25d-bb9d258733cc tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-90abfafe-9892-4677-b25d-bb9d258733cc tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-90abfafe-9892-4677-b25d-bb9d258733cc tempest-ProjectMemberTests-1426758417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:52 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-90abfafe-9892-4677-b25d-bb9d258733cc tempest-ProjectMemberTests-1426758417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-90abfafe-9892-4677-b25d-bb9d258733cc tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:52 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-90abfafe-9892-4677-b25d-bb9d258733cc tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:52 devstack sudo[115413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:58:52 devstack sudo[115413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:53 devstack sudo[115413]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-90abfafe-9892-4677-b25d-bb9d258733cc tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.272s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-90abfafe-9892-4677-b25d-bb9d258733cc tempest-ProjectMemberTests-1426758417 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:58:53 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-90abfafe-9892-4677-b25d-bb9d258733cc tempest-ProjectMemberTests-1426758417 None] Deleted volume successfully. Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-90abfafe-9892-4677-b25d-bb9d258733cc tempest-ProjectMemberTests-1426758417 None] Lock "cinder-fccf3258-780b-4d28-84b2-5ede40a35e11-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Flow 'volume_create_manager' (a984559e-c722-44e5-99bd-782be1bdc8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a46cb3-cd92-4edd-b0d7-1e69ec402649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a46cb3-cd92-4edd-b0d7-1e69ec402649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1907722058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ebd985c-23aa-4a1a-841c-e580850744fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8658e7bcb5964a65a4672729d843a24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:53Z,use_quota=True,user_id='d1b1c78558e94e16b33cfaf2594e5ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e2861b-fe8d-457a-bcfd-6edffd0ffef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e2861b-fe8d-457a-bcfd-6edffd0ffef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5132e9aa-0b54-4720-a45f-54f57f2ccde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5132e9aa-0b54-4720-a45f-54f57f2ccde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ebd985c-23aa-4a1a-841c-e580850744fb', 'volume_name': 'volume-8ebd985c-23aa-4a1a-841c-e580850744fb', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43a8af6d-b5b9-4ab9-8ea1-455cf70c4a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43a8af6d-b5b9-4ab9-8ea1-455cf70c4a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760fcd08-763a-4bac-9fd5-ec1280905414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:53 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Volume 8ebd985c-23aa-4a1a-841c-e580850744fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ebd985c-23aa-4a1a-841c-e580850744fb', 'volume_size': 1} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1907722058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ebd985c-23aa-4a1a-841c-e580850744fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8658e7bcb5964a65a4672729d843a24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:58:53Z,use_quota=True,user_id='d1b1c78558e94e16b33cfaf2594e5ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Creating volume 8ebd985c-23aa-4a1a-841c-e580850744fb {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:58:53 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:53 devstack sudo[115418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb 1073741824 Aug 27 03:58:53 devstack sudo[115418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-cc83f470-fe4e-45ff-80d5-e669cee4c161 tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-b9d61172-a4f7-416b-a92f-ab0afcf389d5-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-cc83f470-fe4e-45ff-80d5-e669cee4c161 tempest-ProjectReaderTests-806833313 None] Lock "cinder-b9d61172-a4f7-416b-a92f-ab0afcf389d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-cc83f470-fe4e-45ff-80d5-e669cee4c161 tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-quobyte-2498e296-161e-436a-80f3-829b15690bcd" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-cc83f470-fe4e-45ff-80d5-e669cee4c161 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-2498e296-161e-436a-80f3-829b15690bcd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-cc83f470-fe4e-45ff-80d5-e669cee4c161 tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-quobyte-b9d61172-a4f7-416b-a92f-ab0afcf389d5" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-cc83f470-fe4e-45ff-80d5-e669cee4c161 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-b9d61172-a4f7-416b-a92f-ab0afcf389d5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-cc83f470-fe4e-45ff-80d5-e669cee4c161 tempest-ProjectReaderTests-806833313 None] Deleting offline snapshot b9d61172-a4f7-416b-a92f-ab0afcf389d5 of volume 2498e296-161e-436a-80f3-829b15690bcd {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-cc83f470-fe4e-45ff-80d5-e669cee4c161 tempest-ProjectReaderTests-806833313 None] snapshot_file for this snap is: volume-2498e296-161e-436a-80f3-829b15690bcd.b9d61172-a4f7-416b-a92f-ab0afcf389d5 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[e920d14f-9ec1-44de-ae57-dd0d9fde00ac]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:53 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cc83f470-fe4e-45ff-80d5-e669cee4c161 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.b9d61172-a4f7-416b-a92f-ab0afcf389d5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:54 devstack sudo[115418]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb 1073741824" returned: 0 in 0.504s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:54 devstack sudo[115423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.b9d61172-a4f7-416b-a92f-ab0afcf389d5 Aug 27 03:58:54 devstack sudo[115423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:54 devstack sudo[115425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb Aug 27 03:58:54 devstack sudo[115425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:54 devstack sudo[115423]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cc83f470-fe4e-45ff-80d5-e669cee4c161 tempest-ProjectReaderTests-806833313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.b9d61172-a4f7-416b-a92f-ab0afcf389d5" returned: 0 in 0.436s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:54 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-cc83f470-fe4e-45ff-80d5-e669cee4c161 tempest-ProjectReaderTests-806833313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2498e296-161e-436a-80f3-829b15690bcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:58:54 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56d9a87-a55d-40f8-aa12-1df29860bbc4]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cc83f470-fe4e-45ff-80d5-e669cee4c161 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:54 devstack sudo[115425]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb" returned: 0 in 0.307s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:54 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:58:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760fcd08-763a-4bac-9fd5-ec1280905414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ebd985c-23aa-4a1a-841c-e580850744fb', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42da8d49-a449-4d33-bbb2-8b169ce08c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:58:54 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Volume volume-8ebd985c-23aa-4a1a-841c-e580850744fb (8ebd985c-23aa-4a1a-841c-e580850744fb): created successfully Aug 27 03:58:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42da8d49-a449-4d33-bbb2-8b169ce08c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:58:54 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Flow 'volume_create_manager' (a984559e-c722-44e5-99bd-782be1bdc8a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:58:54 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-95a8fc05-3f0e-4ca2-832c-a37ccb45917c tempest-ProjectMemberTests-1426758417 None] Created volume successfully. Aug 27 03:58:54 devstack sudo[115432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd Aug 27 03:58:54 devstack sudo[115432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:54 devstack sudo[115432]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cc83f470-fe4e-45ff-80d5-e669cee4c161 tempest-ProjectReaderTests-806833313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd" returned: 0 in 0.365s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:54 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cc83f470-fe4e-45ff-80d5-e669cee4c161 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.b9d61172-a4f7-416b-a92f-ab0afcf389d5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:54 devstack sudo[115437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.b9d61172-a4f7-416b-a92f-ab0afcf389d5 Aug 27 03:58:54 devstack sudo[115437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:55 devstack sudo[115437]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cc83f470-fe4e-45ff-80d5-e669cee4c161 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.b9d61172-a4f7-416b-a92f-ab0afcf389d5" returned: 0 in 0.331s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cc83f470-fe4e-45ff-80d5-e669cee4c161 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.b9d61172-a4f7-416b-a92f-ab0afcf389d5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:55 devstack sudo[115442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.b9d61172-a4f7-416b-a92f-ab0afcf389d5 Aug 27 03:58:55 devstack sudo[115442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:55 devstack sudo[115442]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-cc83f470-fe4e-45ff-80d5-e669cee4c161 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd.b9d61172-a4f7-416b-a92f-ab0afcf389d5" returned: 0 in 0.260s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:55 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-cc83f470-fe4e-45ff-80d5-e669cee4c161 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-b9d61172-a4f7-416b-a92f-ab0afcf389d5" released by "_delete_snapshot" :: held 1.490s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:55 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-cc83f470-fe4e-45ff-80d5-e669cee4c161 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-2498e296-161e-436a-80f3-829b15690bcd" released by "delete_snapshot" :: held 1.519s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:55 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-cc83f470-fe4e-45ff-80d5-e669cee4c161 tempest-ProjectReaderTests-806833313 None] Created reservations ['24bfc906-bd0b-4ea0-9c3a-fb1de1c7afa4', '61aaf511-15ef-4d14-9854-78614171efa6', '1e86fcc9-0f7b-4937-9429-cd057c26b035', 'ed0df2d0-4bbb-4c62-a280-192effd1f80a'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:55 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-cc83f470-fe4e-45ff-80d5-e669cee4c161 tempest-ProjectReaderTests-806833313 None] Delete snapshot completed successfully. Aug 27 03:58:55 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-cc83f470-fe4e-45ff-80d5-e669cee4c161 tempest-ProjectReaderTests-806833313 None] Lock "cinder-b9d61172-a4f7-416b-a92f-ab0afcf389d5-delete_snapshot" released by "delete_snapshot" :: held 1.676s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-983d0f95-5fa9-41fb-94fb-15a1bcb4cc7e tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-983d0f95-5fa9-41fb-94fb-15a1bcb4cc7e tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:55 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-983d0f95-5fa9-41fb-94fb-15a1bcb4cc7e tempest-ProjectMemberTests-1426758417 None] Creating offline snapshot a5d1a9ff-07b4-423f-b261-3a90b56388e5 of volume 8ebd985c-23aa-4a1a-841c-e580850744fb {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:58:55 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[13406f78-0c4a-464f-8d77-36935566670b]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:55 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-983d0f95-5fa9-41fb-94fb-15a1bcb4cc7e tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:55 devstack sudo[115445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb Aug 27 03:58:55 devstack sudo[115445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:56 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5edf1bf9-4eba-4218-9866-223b28018f11 tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-2498e296-161e-436a-80f3-829b15690bcd-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:56 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5edf1bf9-4eba-4218-9866-223b28018f11 tempest-ProjectReaderTests-806833313 None] Lock "cinder-2498e296-161e-436a-80f3-829b15690bcd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:56 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5edf1bf9-4eba-4218-9866-223b28018f11 tempest-ProjectReaderTests-806833313 None] Acquiring lock "cinder-quobyte-2498e296-161e-436a-80f3-829b15690bcd" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:56 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5edf1bf9-4eba-4218-9866-223b28018f11 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-2498e296-161e-436a-80f3-829b15690bcd" acquired by "delete_volume" :: waited 0.016s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:56 devstack sudo[115445]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:56 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[011f9ca0-8e08-4a69-a186-d64ff4e6b278]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5edf1bf9-4eba-4218-9866-223b28018f11 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-983d0f95-5fa9-41fb-94fb-15a1bcb4cc7e tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb" returned: 0 in 0.428s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-983d0f95-5fa9-41fb-94fb-15a1bcb4cc7e tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.a5d1a9ff-07b4-423f-b261-3a90b56388e5 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:56 devstack sudo[115451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.a5d1a9ff-07b4-423f-b261-3a90b56388e5 1G Aug 27 03:58:56 devstack sudo[115451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:56 devstack sudo[115450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd Aug 27 03:58:56 devstack sudo[115450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:56 devstack sudo[115450]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5edf1bf9-4eba-4218-9866-223b28018f11 tempest-ProjectReaderTests-806833313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd" returned: 0 in 0.406s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5edf1bf9-4eba-4218-9866-223b28018f11 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:56 devstack sudo[115451]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-983d0f95-5fa9-41fb-94fb-15a1bcb4cc7e tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.a5d1a9ff-07b4-423f-b261-3a90b56388e5 1G" returned: 0 in 0.402s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-983d0f95-5fa9-41fb-94fb-15a1bcb4cc7e tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ebd985c-23aa-4a1a-841c-e580850744fb -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.a5d1a9ff-07b4-423f-b261-3a90b56388e5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:56 devstack sudo[115461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd Aug 27 03:58:56 devstack sudo[115461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:56 devstack sudo[115462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ebd985c-23aa-4a1a-841c-e580850744fb -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.a5d1a9ff-07b4-423f-b261-3a90b56388e5 Aug 27 03:58:56 devstack sudo[115462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:56 devstack sudo[115461]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5edf1bf9-4eba-4218-9866-223b28018f11 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-2498e296-161e-436a-80f3-829b15690bcd" returned: 0 in 0.258s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:56 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5edf1bf9-4eba-4218-9866-223b28018f11 tempest-ProjectReaderTests-806833313 None] Lock "cinder-quobyte-2498e296-161e-436a-80f3-829b15690bcd" released by "delete_volume" :: held 0.734s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:56 devstack sudo[115462]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-983d0f95-5fa9-41fb-94fb-15a1bcb4cc7e tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ebd985c-23aa-4a1a-841c-e580850744fb -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.a5d1a9ff-07b4-423f-b261-3a90b56388e5" returned: 0 in 0.293s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:56 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-983d0f95-5fa9-41fb-94fb-15a1bcb4cc7e tempest-ProjectMemberTests-1426758417 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.a5d1a9ff-07b4-423f-b261-3a90b56388e5 is being set with open permissions: ugo+rw Aug 27 03:58:56 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-983d0f95-5fa9-41fb-94fb-15a1bcb4cc7e tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.a5d1a9ff-07b4-423f-b261-3a90b56388e5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:56 devstack sudo[115469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.a5d1a9ff-07b4-423f-b261-3a90b56388e5 Aug 27 03:58:56 devstack sudo[115469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:56 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-5edf1bf9-4eba-4218-9866-223b28018f11 tempest-ProjectReaderTests-806833313 None] Created reservations ['7e322261-0dec-45c0-ab5d-a61a7d502bc1', 'd8f0a1a7-6ffd-4c0b-8cf8-bbe2da387757', '65cef57d-50ee-4813-9065-4a1e38c6eb43', '423442fa-601f-4719-bdea-7535cde993be'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:58:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5edf1bf9-4eba-4218-9866-223b28018f11 tempest-ProjectReaderTests-806833313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:58:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5edf1bf9-4eba-4218-9866-223b28018f11 tempest-ProjectReaderTests-806833313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:58:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5edf1bf9-4eba-4218-9866-223b28018f11 tempest-ProjectReaderTests-806833313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:58:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5edf1bf9-4eba-4218-9866-223b28018f11 tempest-ProjectReaderTests-806833313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:58:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5edf1bf9-4eba-4218-9866-223b28018f11 tempest-ProjectReaderTests-806833313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5edf1bf9-4eba-4218-9866-223b28018f11 tempest-ProjectReaderTests-806833313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:57 devstack sudo[115471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:58:57 devstack sudo[115471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:57 devstack sudo[115469]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-983d0f95-5fa9-41fb-94fb-15a1bcb4cc7e tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.a5d1a9ff-07b4-423f-b261-3a90b56388e5" returned: 0 in 0.233s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-983d0f95-5fa9-41fb-94fb-15a1bcb4cc7e tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:57 devstack sudo[115474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.info Aug 27 03:58:57 devstack sudo[115474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:57 devstack sudo[115471]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5edf1bf9-4eba-4218-9866-223b28018f11 tempest-ProjectReaderTests-806833313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.273s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:57 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-5edf1bf9-4eba-4218-9866-223b28018f11 tempest-ProjectReaderTests-806833313 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:58:57 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-5edf1bf9-4eba-4218-9866-223b28018f11 tempest-ProjectReaderTests-806833313 None] Deleted volume successfully. Aug 27 03:58:57 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5edf1bf9-4eba-4218-9866-223b28018f11 tempest-ProjectReaderTests-806833313 None] Lock "cinder-2498e296-161e-436a-80f3-829b15690bcd-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:58:57 devstack sudo[115474]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-983d0f95-5fa9-41fb-94fb-15a1bcb4cc7e tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.info" returned: 0 in 0.298s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:57 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-983d0f95-5fa9-41fb-94fb-15a1bcb4cc7e tempest-ProjectMemberTests-1426758417 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.info is being set with open permissions: ugo+rw Aug 27 03:58:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-983d0f95-5fa9-41fb-94fb-15a1bcb4cc7e tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:57 devstack sudo[115478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.info Aug 27 03:58:57 devstack sudo[115478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:57 devstack sudo[115478]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-983d0f95-5fa9-41fb-94fb-15a1bcb4cc7e tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.info" returned: 0 in 0.257s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-983d0f95-5fa9-41fb-94fb-15a1bcb4cc7e tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.003s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:58:57 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-983d0f95-5fa9-41fb-94fb-15a1bcb4cc7e tempest-ProjectMemberTests-1426758417 None] Create snapshot completed successfully Aug 27 03:58:58 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-458588a4-068a-4172-b83b-5f0802bb6ad0 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-a5d1a9ff-07b4-423f-b261-3a90b56388e5-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:58 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-458588a4-068a-4172-b83b-5f0802bb6ad0 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-a5d1a9ff-07b4-423f-b261-3a90b56388e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:58 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-458588a4-068a-4172-b83b-5f0802bb6ad0 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-8ebd985c-23aa-4a1a-841c-e580850744fb" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:58 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-458588a4-068a-4172-b83b-5f0802bb6ad0 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-8ebd985c-23aa-4a1a-841c-e580850744fb" acquired by "delete_snapshot" :: waited 0.013s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:58 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-458588a4-068a-4172-b83b-5f0802bb6ad0 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-a5d1a9ff-07b4-423f-b261-3a90b56388e5" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:58:58 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-458588a4-068a-4172-b83b-5f0802bb6ad0 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-a5d1a9ff-07b4-423f-b261-3a90b56388e5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:58:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-458588a4-068a-4172-b83b-5f0802bb6ad0 tempest-ProjectMemberTests-1426758417 None] Deleting offline snapshot a5d1a9ff-07b4-423f-b261-3a90b56388e5 of volume 8ebd985c-23aa-4a1a-841c-e580850744fb {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:58:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-458588a4-068a-4172-b83b-5f0802bb6ad0 tempest-ProjectMemberTests-1426758417 None] snapshot_file for this snap is: volume-8ebd985c-23aa-4a1a-841c-e580850744fb.a5d1a9ff-07b4-423f-b261-3a90b56388e5 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:58:59 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[c240796b-4b9f-4156-9e1c-1d44fa4f8a09]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-458588a4-068a-4172-b83b-5f0802bb6ad0 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.a5d1a9ff-07b4-423f-b261-3a90b56388e5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:59 devstack sudo[115481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.a5d1a9ff-07b4-423f-b261-3a90b56388e5 Aug 27 03:58:59 devstack sudo[115481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:59 devstack sudo[115481]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-458588a4-068a-4172-b83b-5f0802bb6ad0 tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.a5d1a9ff-07b4-423f-b261-3a90b56388e5" returned: 0 in 0.381s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:59 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-458588a4-068a-4172-b83b-5f0802bb6ad0 tempest-ProjectMemberTests-1426758417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ebd985c-23aa-4a1a-841c-e580850744fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:58:59 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[535552fb-da37-4fd8-9acf-298086bfcf4a]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:58:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-458588a4-068a-4172-b83b-5f0802bb6ad0 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:59 devstack sudo[115486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb Aug 27 03:58:59 devstack sudo[115486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:58:59 devstack sudo[115486]: pam_unix(sudo:session): session closed for user root Aug 27 03:58:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-458588a4-068a-4172-b83b-5f0802bb6ad0 tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb" returned: 0 in 0.401s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:58:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-458588a4-068a-4172-b83b-5f0802bb6ad0 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.a5d1a9ff-07b4-423f-b261-3a90b56388e5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:58:59 devstack sudo[115491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.a5d1a9ff-07b4-423f-b261-3a90b56388e5 Aug 27 03:58:59 devstack sudo[115491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:00 devstack sudo[115491]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-458588a4-068a-4172-b83b-5f0802bb6ad0 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.a5d1a9ff-07b4-423f-b261-3a90b56388e5" returned: 0 in 0.379s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-458588a4-068a-4172-b83b-5f0802bb6ad0 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.a5d1a9ff-07b4-423f-b261-3a90b56388e5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:00 devstack sudo[115497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.a5d1a9ff-07b4-423f-b261-3a90b56388e5 Aug 27 03:59:00 devstack sudo[115497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:00 devstack sudo[115497]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-458588a4-068a-4172-b83b-5f0802bb6ad0 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb.a5d1a9ff-07b4-423f-b261-3a90b56388e5" returned: 0 in 0.275s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-458588a4-068a-4172-b83b-5f0802bb6ad0 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-a5d1a9ff-07b4-423f-b261-3a90b56388e5" released by "_delete_snapshot" :: held 1.539s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:59:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-458588a4-068a-4172-b83b-5f0802bb6ad0 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-8ebd985c-23aa-4a1a-841c-e580850744fb" released by "delete_snapshot" :: held 1.570s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:59:00 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-458588a4-068a-4172-b83b-5f0802bb6ad0 tempest-ProjectMemberTests-1426758417 None] Created reservations ['1c8f9fa1-71a0-474b-9e3f-bbe6ec831fd0', '47057d77-84a7-410b-8507-7c5a169f8d6b', 'c8791427-7006-4f12-b0fc-bef0f95da1d8', '42ddc431-64a0-4dc6-ac34-f6d3338f3ece'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:59:00 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-458588a4-068a-4172-b83b-5f0802bb6ad0 tempest-ProjectMemberTests-1426758417 None] Delete snapshot completed successfully. Aug 27 03:59:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-458588a4-068a-4172-b83b-5f0802bb6ad0 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-a5d1a9ff-07b4-423f-b261-3a90b56388e5-delete_snapshot" released by "delete_snapshot" :: held 1.754s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:59:01 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ab0de34f-07fb-4aa3-9d40-bc029bcdcc48 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-8ebd985c-23aa-4a1a-841c-e580850744fb-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:59:01 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ab0de34f-07fb-4aa3-9d40-bc029bcdcc48 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-8ebd985c-23aa-4a1a-841c-e580850744fb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:59:01 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ab0de34f-07fb-4aa3-9d40-bc029bcdcc48 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-8ebd985c-23aa-4a1a-841c-e580850744fb" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:59:01 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ab0de34f-07fb-4aa3-9d40-bc029bcdcc48 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-8ebd985c-23aa-4a1a-841c-e580850744fb" acquired by "delete_volume" :: waited 0.021s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:59:01 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea6631d-8988-42ed-b8b2-cceca4c45aa2]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:59:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ab0de34f-07fb-4aa3-9d40-bc029bcdcc48 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:01 devstack sudo[115501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb Aug 27 03:59:01 devstack sudo[115501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:01 devstack sudo[115501]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ab0de34f-07fb-4aa3-9d40-bc029bcdcc48 tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb" returned: 0 in 0.388s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ab0de34f-07fb-4aa3-9d40-bc029bcdcc48 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:01 devstack sudo[115506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb Aug 27 03:59:01 devstack sudo[115506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:01 devstack sudo[115506]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ab0de34f-07fb-4aa3-9d40-bc029bcdcc48 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-8ebd985c-23aa-4a1a-841c-e580850744fb" returned: 0 in 0.261s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:01 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ab0de34f-07fb-4aa3-9d40-bc029bcdcc48 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-8ebd985c-23aa-4a1a-841c-e580850744fb" released by "delete_volume" :: held 0.716s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:59:01 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-ab0de34f-07fb-4aa3-9d40-bc029bcdcc48 tempest-ProjectMemberTests-1426758417 None] Created reservations ['4917f024-6b63-4c5b-bbad-9c582d6a9a88', 'd7d0087e-e866-4e02-9008-2115adc6800a', '7313b570-5075-4653-95f7-be64c2aeea2b', '03ad5b89-ddd1-4a98-848c-345dd8ccba44'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:59:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ab0de34f-07fb-4aa3-9d40-bc029bcdcc48 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ab0de34f-07fb-4aa3-9d40-bc029bcdcc48 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:02 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ab0de34f-07fb-4aa3-9d40-bc029bcdcc48 tempest-ProjectMemberTests-1426758417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:59:02 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ab0de34f-07fb-4aa3-9d40-bc029bcdcc48 tempest-ProjectMemberTests-1426758417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:59:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ab0de34f-07fb-4aa3-9d40-bc029bcdcc48 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ab0de34f-07fb-4aa3-9d40-bc029bcdcc48 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:02 devstack sudo[115509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:59:02 devstack sudo[115509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:02 devstack sudo[115509]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:02 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ab0de34f-07fb-4aa3-9d40-bc029bcdcc48 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.295s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:02 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-ab0de34f-07fb-4aa3-9d40-bc029bcdcc48 tempest-ProjectMemberTests-1426758417 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:59:02 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-ab0de34f-07fb-4aa3-9d40-bc029bcdcc48 tempest-ProjectMemberTests-1426758417 None] Deleted volume successfully. Aug 27 03:59:02 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-ab0de34f-07fb-4aa3-9d40-bc029bcdcc48 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-8ebd985c-23aa-4a1a-841c-e580850744fb-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:59:02 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:59:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Flow 'volume_create_manager' (ddee46b0-186e-4bc6-acd9-95603f216495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:59:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2361f48-b2b2-4845-b52c-917c86aaf439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2361f48-b2b2-4845-b52c-917c86aaf439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1505482640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d53fc6-16dd-4779-ab80-91d3b08723c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8658e7bcb5964a65a4672729d843a24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:59:03Z,use_quota=True,user_id='d1b1c78558e94e16b33cfaf2594e5ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e4e09b-35b2-4ee3-8017-f0248d81eeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e4e09b-35b2-4ee3-8017-f0248d81eeff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (451a78f9-3b77-45b4-9709-1e7a27614b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:02 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (451a78f9-3b77-45b4-9709-1e7a27614b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50d53fc6-16dd-4779-ab80-91d3b08723c5', 'volume_name': 'volume-50d53fc6-16dd-4779-ab80-91d3b08723c5', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:03 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d268fb8a-be56-45bd-9174-3d0d46ac1502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:03 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d268fb8a-be56-45bd-9174-3d0d46ac1502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:03 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a34eb3-0568-43fe-a4ba-3719532c71b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:03 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Volume 50d53fc6-16dd-4779-ab80-91d3b08723c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50d53fc6-16dd-4779-ab80-91d3b08723c5', 'volume_size': 1} Aug 27 03:59:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:03 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1505482640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d53fc6-16dd-4779-ab80-91d3b08723c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8658e7bcb5964a65a4672729d843a24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:59:03Z,use_quota=True,user_id='d1b1c78558e94e16b33cfaf2594e5ab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:59:03 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Creating volume 50d53fc6-16dd-4779-ab80-91d3b08723c5 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:59:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:03 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:59:03 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:59:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:03 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:59:03 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:59:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:03 devstack sudo[115512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5 1073741824 Aug 27 03:59:03 devstack sudo[115512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:03 devstack sudo[115512]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5 1073741824" returned: 0 in 0.447s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:03 devstack sudo[115521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5 Aug 27 03:59:03 devstack sudo[115521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:03 devstack sudo[115521]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5" returned: 0 in 0.254s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:03 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:59:03 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:03 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a34eb3-0568-43fe-a4ba-3719532c71b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50d53fc6-16dd-4779-ab80-91d3b08723c5', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:03 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4576b1be-32d9-486d-8c34-0a5daae98d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:03 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Volume volume-50d53fc6-16dd-4779-ab80-91d3b08723c5 (50d53fc6-16dd-4779-ab80-91d3b08723c5): created successfully Aug 27 03:59:03 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4576b1be-32d9-486d-8c34-0a5daae98d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:03 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Flow 'volume_create_manager' (ddee46b0-186e-4bc6-acd9-95603f216495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:59:03 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-ef745584-7e13-4c0f-bebd-37ed412baf76 tempest-ProjectMemberTests-1426758417 None] Created volume successfully. Aug 27 03:59:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-331aeaf9-e1f3-4cd0-8d77-75532352a51b tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-331aeaf9-e1f3-4cd0-8d77-75532352a51b tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:05 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-331aeaf9-e1f3-4cd0-8d77-75532352a51b tempest-ProjectMemberTests-1426758417 None] Creating offline snapshot b96bec6f-89d3-47f3-8548-3f64b137156e of volume 50d53fc6-16dd-4779-ab80-91d3b08723c5 {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:59:05 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d86288-bda7-4dab-a5f1-4d5da19277e6]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:59:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-331aeaf9-e1f3-4cd0-8d77-75532352a51b tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:05 devstack sudo[115524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5 Aug 27 03:59:05 devstack sudo[115524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:05 devstack sudo[115524]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-331aeaf9-e1f3-4cd0-8d77-75532352a51b tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5" returned: 0 in 0.369s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-331aeaf9-e1f3-4cd0-8d77-75532352a51b tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.b96bec6f-89d3-47f3-8548-3f64b137156e 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:05 devstack sudo[115530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.b96bec6f-89d3-47f3-8548-3f64b137156e 1G Aug 27 03:59:05 devstack sudo[115530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:05 devstack sudo[115530]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-331aeaf9-e1f3-4cd0-8d77-75532352a51b tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.b96bec6f-89d3-47f3-8548-3f64b137156e 1G" returned: 0 in 0.494s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-331aeaf9-e1f3-4cd0-8d77-75532352a51b tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50d53fc6-16dd-4779-ab80-91d3b08723c5 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.b96bec6f-89d3-47f3-8548-3f64b137156e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:06 devstack sudo[115536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50d53fc6-16dd-4779-ab80-91d3b08723c5 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.b96bec6f-89d3-47f3-8548-3f64b137156e Aug 27 03:59:06 devstack sudo[115536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:06 devstack sudo[115536]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-331aeaf9-e1f3-4cd0-8d77-75532352a51b tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50d53fc6-16dd-4779-ab80-91d3b08723c5 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.b96bec6f-89d3-47f3-8548-3f64b137156e" returned: 0 in 0.345s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:06 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-331aeaf9-e1f3-4cd0-8d77-75532352a51b tempest-ProjectMemberTests-1426758417 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.b96bec6f-89d3-47f3-8548-3f64b137156e is being set with open permissions: ugo+rw Aug 27 03:59:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-331aeaf9-e1f3-4cd0-8d77-75532352a51b tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.b96bec6f-89d3-47f3-8548-3f64b137156e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:06 devstack sudo[115542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.b96bec6f-89d3-47f3-8548-3f64b137156e Aug 27 03:59:06 devstack sudo[115542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:06 devstack sudo[115542]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-331aeaf9-e1f3-4cd0-8d77-75532352a51b tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.b96bec6f-89d3-47f3-8548-3f64b137156e" returned: 0 in 0.260s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-331aeaf9-e1f3-4cd0-8d77-75532352a51b tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:06 devstack sudo[115545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.info Aug 27 03:59:06 devstack sudo[115545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:06 devstack sudo[115545]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-331aeaf9-e1f3-4cd0-8d77-75532352a51b tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.info" returned: 0 in 0.278s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:06 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-331aeaf9-e1f3-4cd0-8d77-75532352a51b tempest-ProjectMemberTests-1426758417 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.info is being set with open permissions: ugo+rw Aug 27 03:59:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-331aeaf9-e1f3-4cd0-8d77-75532352a51b tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:06 devstack sudo[115548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.info Aug 27 03:59:06 devstack sudo[115548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:07 devstack sudo[115548]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-331aeaf9-e1f3-4cd0-8d77-75532352a51b tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.info" returned: 0 in 0.254s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-331aeaf9-e1f3-4cd0-8d77-75532352a51b tempest-ProjectMemberTests-1426758417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.099s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:07 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-331aeaf9-e1f3-4cd0-8d77-75532352a51b tempest-ProjectMemberTests-1426758417 None] Create snapshot completed successfully Aug 27 03:59:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d9bc2bf9-8666-4c97-81b8-91742e8f74c0 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-b96bec6f-89d3-47f3-8548-3f64b137156e-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:59:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d9bc2bf9-8666-4c97-81b8-91742e8f74c0 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-b96bec6f-89d3-47f3-8548-3f64b137156e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:59:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d9bc2bf9-8666-4c97-81b8-91742e8f74c0 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-50d53fc6-16dd-4779-ab80-91d3b08723c5" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:59:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d9bc2bf9-8666-4c97-81b8-91742e8f74c0 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-50d53fc6-16dd-4779-ab80-91d3b08723c5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:59:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d9bc2bf9-8666-4c97-81b8-91742e8f74c0 tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-b96bec6f-89d3-47f3-8548-3f64b137156e" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:59:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d9bc2bf9-8666-4c97-81b8-91742e8f74c0 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-b96bec6f-89d3-47f3-8548-3f64b137156e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:59:08 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-d9bc2bf9-8666-4c97-81b8-91742e8f74c0 tempest-ProjectMemberTests-1426758417 None] Deleting offline snapshot b96bec6f-89d3-47f3-8548-3f64b137156e of volume 50d53fc6-16dd-4779-ab80-91d3b08723c5 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 03:59:08 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-d9bc2bf9-8666-4c97-81b8-91742e8f74c0 tempest-ProjectMemberTests-1426758417 None] snapshot_file for this snap is: volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.b96bec6f-89d3-47f3-8548-3f64b137156e {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 03:59:08 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3941806-29de-46fd-83a1-9797ffd54508]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:59:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d9bc2bf9-8666-4c97-81b8-91742e8f74c0 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.b96bec6f-89d3-47f3-8548-3f64b137156e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:08 devstack sudo[115551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.b96bec6f-89d3-47f3-8548-3f64b137156e Aug 27 03:59:08 devstack sudo[115551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:08 devstack sudo[115551]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d9bc2bf9-8666-4c97-81b8-91742e8f74c0 tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.b96bec6f-89d3-47f3-8548-3f64b137156e" returned: 0 in 0.330s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:08 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-d9bc2bf9-8666-4c97-81b8-91742e8f74c0 tempest-ProjectMemberTests-1426758417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50d53fc6-16dd-4779-ab80-91d3b08723c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 03:59:08 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb0dd80-e609-4dd1-b32f-dca7e9f121e9]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:59:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d9bc2bf9-8666-4c97-81b8-91742e8f74c0 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:08 devstack sudo[115556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5 Aug 27 03:59:08 devstack sudo[115556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:09 devstack sudo[115556]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d9bc2bf9-8666-4c97-81b8-91742e8f74c0 tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5" returned: 0 in 0.334s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d9bc2bf9-8666-4c97-81b8-91742e8f74c0 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.b96bec6f-89d3-47f3-8548-3f64b137156e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:09 devstack sudo[115561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.b96bec6f-89d3-47f3-8548-3f64b137156e Aug 27 03:59:09 devstack sudo[115561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:09 devstack sudo[115561]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d9bc2bf9-8666-4c97-81b8-91742e8f74c0 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.b96bec6f-89d3-47f3-8548-3f64b137156e" returned: 0 in 0.309s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d9bc2bf9-8666-4c97-81b8-91742e8f74c0 tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.b96bec6f-89d3-47f3-8548-3f64b137156e {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:09 devstack sudo[115566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.b96bec6f-89d3-47f3-8548-3f64b137156e Aug 27 03:59:09 devstack sudo[115566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:09 devstack sudo[115566]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d9bc2bf9-8666-4c97-81b8-91742e8f74c0 tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5.b96bec6f-89d3-47f3-8548-3f64b137156e" returned: 0 in 0.227s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d9bc2bf9-8666-4c97-81b8-91742e8f74c0 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-b96bec6f-89d3-47f3-8548-3f64b137156e" released by "_delete_snapshot" :: held 1.274s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:59:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d9bc2bf9-8666-4c97-81b8-91742e8f74c0 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-50d53fc6-16dd-4779-ab80-91d3b08723c5" released by "delete_snapshot" :: held 1.295s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:59:09 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-d9bc2bf9-8666-4c97-81b8-91742e8f74c0 tempest-ProjectMemberTests-1426758417 None] Created reservations ['5421b3e2-a4e5-4258-8de6-fd9958726acd', 'c8ec431b-8d81-4481-b447-bde79b18ed8d', '5c2b6b1d-52d4-49a2-9b9f-4e725c86a83a', '2f819936-b883-4895-aa1a-053d34ababd2'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:59:09 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d9bc2bf9-8666-4c97-81b8-91742e8f74c0 tempest-ProjectMemberTests-1426758417 None] Delete snapshot completed successfully. Aug 27 03:59:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d9bc2bf9-8666-4c97-81b8-91742e8f74c0 tempest-ProjectMemberTests-1426758417 None] Lock "cinder-b96bec6f-89d3-47f3-8548-3f64b137156e-delete_snapshot" released by "delete_snapshot" :: held 1.416s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:59:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d2bf5a3c-5e89-40c5-af2e-9eceb38240aa tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-50d53fc6-16dd-4779-ab80-91d3b08723c5-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:59:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d2bf5a3c-5e89-40c5-af2e-9eceb38240aa tempest-ProjectMemberTests-1426758417 None] Lock "cinder-50d53fc6-16dd-4779-ab80-91d3b08723c5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:59:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d2bf5a3c-5e89-40c5-af2e-9eceb38240aa tempest-ProjectMemberTests-1426758417 None] Acquiring lock "cinder-quobyte-50d53fc6-16dd-4779-ab80-91d3b08723c5" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:59:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d2bf5a3c-5e89-40c5-af2e-9eceb38240aa tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-50d53fc6-16dd-4779-ab80-91d3b08723c5" acquired by "delete_volume" :: waited 0.015s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:59:10 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[8834552a-3a58-4b9b-8340-8a2d87f94b5d]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:59:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d2bf5a3c-5e89-40c5-af2e-9eceb38240aa tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:10 devstack sudo[115569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5 Aug 27 03:59:10 devstack sudo[115569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:10 devstack sudo[115569]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d2bf5a3c-5e89-40c5-af2e-9eceb38240aa tempest-ProjectMemberTests-1426758417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5" returned: 0 in 0.331s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d2bf5a3c-5e89-40c5-af2e-9eceb38240aa tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:10 devstack sudo[115574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5 Aug 27 03:59:10 devstack sudo[115574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:11 devstack sudo[115574]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d2bf5a3c-5e89-40c5-af2e-9eceb38240aa tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-50d53fc6-16dd-4779-ab80-91d3b08723c5" returned: 0 in 0.226s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d2bf5a3c-5e89-40c5-af2e-9eceb38240aa tempest-ProjectMemberTests-1426758417 None] Lock "cinder-quobyte-50d53fc6-16dd-4779-ab80-91d3b08723c5" released by "delete_volume" :: held 0.607s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:59:11 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-d2bf5a3c-5e89-40c5-af2e-9eceb38240aa tempest-ProjectMemberTests-1426758417 None] Created reservations ['1203b9ae-6558-4cc0-b1f0-be4dd1a95465', '5db9b01f-de8f-461b-b4c6-8b884c7af6c9', '64efc924-b8cf-4c23-896d-684ddc9ecc09', '6c844aac-0d7c-415c-9c8e-376833c6ea8c'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:59:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d2bf5a3c-5e89-40c5-af2e-9eceb38240aa tempest-ProjectMemberTests-1426758417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d2bf5a3c-5e89-40c5-af2e-9eceb38240aa tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d2bf5a3c-5e89-40c5-af2e-9eceb38240aa tempest-ProjectMemberTests-1426758417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:59:11 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d2bf5a3c-5e89-40c5-af2e-9eceb38240aa tempest-ProjectMemberTests-1426758417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:59:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d2bf5a3c-5e89-40c5-af2e-9eceb38240aa tempest-ProjectMemberTests-1426758417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d2bf5a3c-5e89-40c5-af2e-9eceb38240aa tempest-ProjectMemberTests-1426758417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:11 devstack sudo[115577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:59:11 devstack sudo[115577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:11 devstack sudo[115577]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:11 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d2bf5a3c-5e89-40c5-af2e-9eceb38240aa tempest-ProjectMemberTests-1426758417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.228s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:11 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-d2bf5a3c-5e89-40c5-af2e-9eceb38240aa tempest-ProjectMemberTests-1426758417 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:59:11 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d2bf5a3c-5e89-40c5-af2e-9eceb38240aa tempest-ProjectMemberTests-1426758417 None] Deleted volume successfully. Aug 27 03:59:11 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d2bf5a3c-5e89-40c5-af2e-9eceb38240aa tempest-ProjectMemberTests-1426758417 None] Lock "cinder-50d53fc6-16dd-4779-ab80-91d3b08723c5-delete_volume" released by "delete_volume" :: held 1.008s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:59:14 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:59:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:59:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:59:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:14 devstack sudo[115581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:59:14 devstack sudo[115581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:14 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:59:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Flow 'volume_create_manager' (370030de-a71e-4fd3-8cbf-767941c9e415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:59:14 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f385fa-76f2-4ae6-86fa-dda7453fe778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f385fa-76f2-4ae6-86fa-dda7453fe778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1732006567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b710a6a2-d4ae-4d28-9d12-7201f56fc150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b855e72fac43c8903f94a56b582ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:59:15Z,use_quota=True,user_id='87d2039ff6ab48219a592a301935fb46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0689412-6796-488f-aa0b-9a0952a3d6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0689412-6796-488f-aa0b-9a0952a3d6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57acd614-4993-4613-b12f-f95f19b5e349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57acd614-4993-4613-b12f-f95f19b5e349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b710a6a2-d4ae-4d28-9d12-7201f56fc150', 'volume_name': 'volume-b710a6a2-d4ae-4d28-9d12-7201f56fc150', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21056001-86be-4a85-b8fd-77a4cd9f77b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21056001-86be-4a85-b8fd-77a4cd9f77b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33525466-3ecc-4739-8080-5e20afe7e29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:15 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Volume b710a6a2-d4ae-4d28-9d12-7201f56fc150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b710a6a2-d4ae-4d28-9d12-7201f56fc150', 'volume_size': 1} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1732006567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b710a6a2-d4ae-4d28-9d12-7201f56fc150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b855e72fac43c8903f94a56b582ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:59:15Z,use_quota=True,user_id='87d2039ff6ab48219a592a301935fb46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Creating volume b710a6a2-d4ae-4d28-9d12-7201f56fc150 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:59:15 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b710a6a2-d4ae-4d28-9d12-7201f56fc150 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:15 devstack sudo[115583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b710a6a2-d4ae-4d28-9d12-7201f56fc150 1073741824 Aug 27 03:59:15 devstack sudo[115583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:15 devstack sudo[115581]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.246s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager._thread_info {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread count: 28 {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread info: [<_MainThread(MainThread, started 134250325188736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 03:59:15 devstack sudo[115583]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b710a6a2-d4ae-4d28-9d12-7201f56fc150 1073741824" returned: 0 in 0.395s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b710a6a2-d4ae-4d28-9d12-7201f56fc150 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:15 devstack sudo[115589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b710a6a2-d4ae-4d28-9d12-7201f56fc150 Aug 27 03:59:15 devstack sudo[115589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:15 devstack sudo[115589]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b710a6a2-d4ae-4d28-9d12-7201f56fc150" returned: 0 in 0.226s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] <== create_volume: return (658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.661s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33525466-3ecc-4739-8080-5e20afe7e29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b710a6a2-d4ae-4d28-9d12-7201f56fc150', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da527766-e2df-491a-9183-a534a2d85941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:15 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Volume volume-b710a6a2-d4ae-4d28-9d12-7201f56fc150 (b710a6a2-d4ae-4d28-9d12-7201f56fc150): created successfully Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da527766-e2df-491a-9183-a534a2d85941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Flow 'volume_create_manager' (370030de-a71e-4fd3-8cbf-767941c9e415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:59:15 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-2e6930c5-3bfc-433b-b0d2-dfab12a50f41 tempest-ProjectReaderTests-939525465 None] Created volume successfully. Aug 27 03:59:16 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5b4e09bc-7e56-4f84-81af-f7a5a14a3b85 tempest-ProjectReaderTests-939525465 None] Acquiring lock "cinder-b710a6a2-d4ae-4d28-9d12-7201f56fc150-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:59:16 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5b4e09bc-7e56-4f84-81af-f7a5a14a3b85 tempest-ProjectReaderTests-939525465 None] Lock "cinder-b710a6a2-d4ae-4d28-9d12-7201f56fc150-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:59:16 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5b4e09bc-7e56-4f84-81af-f7a5a14a3b85 tempest-ProjectReaderTests-939525465 None] Acquiring lock "cinder-quobyte-b710a6a2-d4ae-4d28-9d12-7201f56fc150" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:59:16 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5b4e09bc-7e56-4f84-81af-f7a5a14a3b85 tempest-ProjectReaderTests-939525465 None] Lock "cinder-quobyte-b710a6a2-d4ae-4d28-9d12-7201f56fc150" acquired by "delete_volume" :: waited 0.013s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:59:16 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9932ef5-86f3-4c2d-9686-726e19416752]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:59:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5b4e09bc-7e56-4f84-81af-f7a5a14a3b85 tempest-ProjectReaderTests-939525465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b710a6a2-d4ae-4d28-9d12-7201f56fc150 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:16 devstack sudo[115592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b710a6a2-d4ae-4d28-9d12-7201f56fc150 Aug 27 03:59:16 devstack sudo[115592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:16 devstack sudo[115592]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5b4e09bc-7e56-4f84-81af-f7a5a14a3b85 tempest-ProjectReaderTests-939525465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b710a6a2-d4ae-4d28-9d12-7201f56fc150" returned: 0 in 0.337s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5b4e09bc-7e56-4f84-81af-f7a5a14a3b85 tempest-ProjectReaderTests-939525465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b710a6a2-d4ae-4d28-9d12-7201f56fc150 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:16 devstack sudo[115597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b710a6a2-d4ae-4d28-9d12-7201f56fc150 Aug 27 03:59:16 devstack sudo[115597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:16 devstack sudo[115597]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5b4e09bc-7e56-4f84-81af-f7a5a14a3b85 tempest-ProjectReaderTests-939525465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-b710a6a2-d4ae-4d28-9d12-7201f56fc150" returned: 0 in 0.235s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:16 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5b4e09bc-7e56-4f84-81af-f7a5a14a3b85 tempest-ProjectReaderTests-939525465 None] Lock "cinder-quobyte-b710a6a2-d4ae-4d28-9d12-7201f56fc150" released by "delete_volume" :: held 0.604s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:59:16 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-5b4e09bc-7e56-4f84-81af-f7a5a14a3b85 tempest-ProjectReaderTests-939525465 None] Created reservations ['69ba43da-7636-4e54-8423-00b734e12b72', 'e7842f1f-5851-4616-8125-89ac6e46c4ee', 'deb7bd14-f2e4-4710-ad9e-4e4efabd3c87', 'c0a91b51-3518-4b0a-8c22-292849beb825'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:59:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5b4e09bc-7e56-4f84-81af-f7a5a14a3b85 tempest-ProjectReaderTests-939525465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5b4e09bc-7e56-4f84-81af-f7a5a14a3b85 tempest-ProjectReaderTests-939525465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:16 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5b4e09bc-7e56-4f84-81af-f7a5a14a3b85 tempest-ProjectReaderTests-939525465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:59:16 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-5b4e09bc-7e56-4f84-81af-f7a5a14a3b85 tempest-ProjectReaderTests-939525465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:59:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-5b4e09bc-7e56-4f84-81af-f7a5a14a3b85 tempest-ProjectReaderTests-939525465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:16 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5b4e09bc-7e56-4f84-81af-f7a5a14a3b85 tempest-ProjectReaderTests-939525465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:16 devstack sudo[115600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:59:16 devstack sudo[115600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:17 devstack sudo[115600]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-5b4e09bc-7e56-4f84-81af-f7a5a14a3b85 tempest-ProjectReaderTests-939525465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.235s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-5b4e09bc-7e56-4f84-81af-f7a5a14a3b85 tempest-ProjectReaderTests-939525465 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:59:17 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-5b4e09bc-7e56-4f84-81af-f7a5a14a3b85 tempest-ProjectReaderTests-939525465 None] Deleted volume successfully. Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-5b4e09bc-7e56-4f84-81af-f7a5a14a3b85 tempest-ProjectReaderTests-939525465 None] Lock "cinder-b710a6a2-d4ae-4d28-9d12-7201f56fc150-delete_volume" released by "delete_volume" :: held 1.018s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Flow 'volume_create_manager' (122347fa-8ebf-41ec-95c2-efa1c52e6271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c69251c-3a29-4d93-96e2-ed05e4a22a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c69251c-3a29-4d93-96e2-ed05e4a22a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1435878274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a33b76fb-ec95-402e-83da-609ec4c2c492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b855e72fac43c8903f94a56b582ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:59:18Z,use_quota=True,user_id='87d2039ff6ab48219a592a301935fb46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc242e0-0887-4dab-9a46-7118a3ad84c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc242e0-0887-4dab-9a46-7118a3ad84c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918cbcae-5e89-4411-a2f3-9d9be0ea4440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918cbcae-5e89-4411-a2f3-9d9be0ea4440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a33b76fb-ec95-402e-83da-609ec4c2c492', 'volume_name': 'volume-a33b76fb-ec95-402e-83da-609ec4c2c492', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c261ac9-4ff7-449b-b9a0-bcc3edb0003c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c261ac9-4ff7-449b-b9a0-bcc3edb0003c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c95ff25-b7d7-4506-aaf7-2bd0c046c0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:17 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Volume a33b76fb-ec95-402e-83da-609ec4c2c492: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a33b76fb-ec95-402e-83da-609ec4c2c492', 'volume_size': 1} Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1435878274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a33b76fb-ec95-402e-83da-609ec4c2c492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b855e72fac43c8903f94a56b582ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:59:18Z,use_quota=True,user_id='87d2039ff6ab48219a592a301935fb46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Creating volume a33b76fb-ec95-402e-83da-609ec4c2c492 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:59:17 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:59:17 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a33b76fb-ec95-402e-83da-609ec4c2c492 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:17 devstack sudo[115603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a33b76fb-ec95-402e-83da-609ec4c2c492 1073741824 Aug 27 03:59:17 devstack sudo[115603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:18 devstack sudo[115603]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a33b76fb-ec95-402e-83da-609ec4c2c492 1073741824" returned: 0 in 0.400s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a33b76fb-ec95-402e-83da-609ec4c2c492 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:18 devstack sudo[115608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a33b76fb-ec95-402e-83da-609ec4c2c492 Aug 27 03:59:18 devstack sudo[115608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:18 devstack sudo[115608]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a33b76fb-ec95-402e-83da-609ec4c2c492" returned: 0 in 0.232s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:18 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:59:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c95ff25-b7d7-4506-aaf7-2bd0c046c0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a33b76fb-ec95-402e-83da-609ec4c2c492', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f450d796-dcf8-4ce9-804f-b7eb72655c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:18 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Volume volume-a33b76fb-ec95-402e-83da-609ec4c2c492 (a33b76fb-ec95-402e-83da-609ec4c2c492): created successfully Aug 27 03:59:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f450d796-dcf8-4ce9-804f-b7eb72655c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:18 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Flow 'volume_create_manager' (122347fa-8ebf-41ec-95c2-efa1c52e6271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:59:18 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-b1e831db-7978-4572-a3a0-cf740fb35bf3 tempest-ProjectReaderTests-939525465 None] Created volume successfully. Aug 27 03:59:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6e425e7f-cd9a-405b-9e17-f5420d963306 tempest-ProjectReaderTests-939525465 None] Acquiring lock "cinder-a33b76fb-ec95-402e-83da-609ec4c2c492-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:59:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6e425e7f-cd9a-405b-9e17-f5420d963306 tempest-ProjectReaderTests-939525465 None] Lock "cinder-a33b76fb-ec95-402e-83da-609ec4c2c492-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:59:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6e425e7f-cd9a-405b-9e17-f5420d963306 tempest-ProjectReaderTests-939525465 None] Acquiring lock "cinder-quobyte-a33b76fb-ec95-402e-83da-609ec4c2c492" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:59:18 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6e425e7f-cd9a-405b-9e17-f5420d963306 tempest-ProjectReaderTests-939525465 None] Lock "cinder-quobyte-a33b76fb-ec95-402e-83da-609ec4c2c492" acquired by "delete_volume" :: waited 0.017s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:59:18 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13c2392-d56c-42f8-8efa-a0afb235ee29]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:59:18 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6e425e7f-cd9a-405b-9e17-f5420d963306 tempest-ProjectReaderTests-939525465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a33b76fb-ec95-402e-83da-609ec4c2c492 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:18 devstack sudo[115647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a33b76fb-ec95-402e-83da-609ec4c2c492 Aug 27 03:59:18 devstack sudo[115647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:19 devstack sudo[115647]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6e425e7f-cd9a-405b-9e17-f5420d963306 tempest-ProjectReaderTests-939525465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a33b76fb-ec95-402e-83da-609ec4c2c492" returned: 0 in 0.340s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6e425e7f-cd9a-405b-9e17-f5420d963306 tempest-ProjectReaderTests-939525465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a33b76fb-ec95-402e-83da-609ec4c2c492 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:19 devstack sudo[115652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a33b76fb-ec95-402e-83da-609ec4c2c492 Aug 27 03:59:19 devstack sudo[115652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:19 devstack sudo[115652]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6e425e7f-cd9a-405b-9e17-f5420d963306 tempest-ProjectReaderTests-939525465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-a33b76fb-ec95-402e-83da-609ec4c2c492" returned: 0 in 0.235s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6e425e7f-cd9a-405b-9e17-f5420d963306 tempest-ProjectReaderTests-939525465 None] Lock "cinder-quobyte-a33b76fb-ec95-402e-83da-609ec4c2c492" released by "delete_volume" :: held 0.614s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:59:19 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-6e425e7f-cd9a-405b-9e17-f5420d963306 tempest-ProjectReaderTests-939525465 None] Created reservations ['236838e6-2d2f-4eab-8e9b-06a526683c16', 'b66da394-2fcb-4d9f-bd5e-05654ea77cd4', '8b0f448e-72cc-4fc9-b184-f973a0971986', 'bfac7aac-cdf2-492b-b28d-70a46d533be4'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:59:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6e425e7f-cd9a-405b-9e17-f5420d963306 tempest-ProjectReaderTests-939525465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6e425e7f-cd9a-405b-9e17-f5420d963306 tempest-ProjectReaderTests-939525465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-6e425e7f-cd9a-405b-9e17-f5420d963306 tempest-ProjectReaderTests-939525465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:59:19 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-6e425e7f-cd9a-405b-9e17-f5420d963306 tempest-ProjectReaderTests-939525465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:59:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-6e425e7f-cd9a-405b-9e17-f5420d963306 tempest-ProjectReaderTests-939525465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6e425e7f-cd9a-405b-9e17-f5420d963306 tempest-ProjectReaderTests-939525465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:19 devstack sudo[115655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:59:19 devstack sudo[115655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:19 devstack sudo[115655]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:19 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-6e425e7f-cd9a-405b-9e17-f5420d963306 tempest-ProjectReaderTests-939525465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.235s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:19 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-6e425e7f-cd9a-405b-9e17-f5420d963306 tempest-ProjectReaderTests-939525465 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:59:19 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-6e425e7f-cd9a-405b-9e17-f5420d963306 tempest-ProjectReaderTests-939525465 None] Deleted volume successfully. Aug 27 03:59:19 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-6e425e7f-cd9a-405b-9e17-f5420d963306 tempest-ProjectReaderTests-939525465 None] Lock "cinder-a33b76fb-ec95-402e-83da-609ec4c2c492-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=156,cinder:INSERT=55,cinder:UPDATE=209,cinder:DELETE=17 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=140,cinder:INSERT=53,cinder:UPDATE=191,cinder:DELETE=14 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Flow 'volume_create_manager' (b07ecaa8-3cce-413a-9217-3b055ae19c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09647e10-f4c7-45c1-b0e4-a0ed0d3915dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09647e10-f4c7-45c1-b0e4-a0ed0d3915dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2083944773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c7b73d-6a99-48ec-8f28-9ea3d041a96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216f8fb9605d4475af4a58dab13404d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:59:27Z,use_quota=True,user_id='80ea3f9946d54f48be2bc2ce31d0d75d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481ab3b1-9f87-4971-8455-b33c899caa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481ab3b1-9f87-4971-8455-b33c899caa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dabf234-f525-4ce1-bab6-e5ffcc673294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dabf234-f525-4ce1-bab6-e5ffcc673294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41c7b73d-6a99-48ec-8f28-9ea3d041a96f', 'volume_name': 'volume-41c7b73d-6a99-48ec-8f28-9ea3d041a96f', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (202a1a76-1375-48be-a192-08dc232bfe06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (202a1a76-1375-48be-a192-08dc232bfe06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e685ca68-2e9b-4f3a-835b-16c1425be01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:27 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Volume 41c7b73d-6a99-48ec-8f28-9ea3d041a96f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41c7b73d-6a99-48ec-8f28-9ea3d041a96f', 'volume_size': 1} Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2083944773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c7b73d-6a99-48ec-8f28-9ea3d041a96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216f8fb9605d4475af4a58dab13404d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:59:27Z,use_quota=True,user_id='80ea3f9946d54f48be2bc2ce31d0d75d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Creating volume 41c7b73d-6a99-48ec-8f28-9ea3d041a96f {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:59:27 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-41c7b73d-6a99-48ec-8f28-9ea3d041a96f 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:27 devstack sudo[115666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-41c7b73d-6a99-48ec-8f28-9ea3d041a96f 1073741824 Aug 27 03:59:27 devstack sudo[115666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:27 devstack sudo[115666]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-41c7b73d-6a99-48ec-8f28-9ea3d041a96f 1073741824" returned: 0 in 0.418s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:27 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-41c7b73d-6a99-48ec-8f28-9ea3d041a96f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:28 devstack sudo[115671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-41c7b73d-6a99-48ec-8f28-9ea3d041a96f Aug 27 03:59:28 devstack sudo[115671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:28 devstack sudo[115671]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-41c7b73d-6a99-48ec-8f28-9ea3d041a96f" returned: 0 in 0.238s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:28 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:59:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e685ca68-2e9b-4f3a-835b-16c1425be01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41c7b73d-6a99-48ec-8f28-9ea3d041a96f', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49ab0f8-9a6d-447b-9806-11a8df5d5afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:28 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Volume volume-41c7b73d-6a99-48ec-8f28-9ea3d041a96f (41c7b73d-6a99-48ec-8f28-9ea3d041a96f): created successfully Aug 27 03:59:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49ab0f8-9a6d-447b-9806-11a8df5d5afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:28 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Flow 'volume_create_manager' (b07ecaa8-3cce-413a-9217-3b055ae19c98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:59:28 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-4171ef23-9cb5-4e80-b357-b51e49788c59 tempest-ProjectReaderTests-794640156 None] Created volume successfully. Aug 27 03:59:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f3dd4eff-69cd-420d-a91e-4afc8ae6e885 tempest-ProjectReaderTests-794640156 None] Acquiring lock "cinder-41c7b73d-6a99-48ec-8f28-9ea3d041a96f-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:59:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f3dd4eff-69cd-420d-a91e-4afc8ae6e885 tempest-ProjectReaderTests-794640156 None] Lock "cinder-41c7b73d-6a99-48ec-8f28-9ea3d041a96f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:59:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f3dd4eff-69cd-420d-a91e-4afc8ae6e885 tempest-ProjectReaderTests-794640156 None] Acquiring lock "cinder-quobyte-41c7b73d-6a99-48ec-8f28-9ea3d041a96f" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:59:28 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f3dd4eff-69cd-420d-a91e-4afc8ae6e885 tempest-ProjectReaderTests-794640156 None] Lock "cinder-quobyte-41c7b73d-6a99-48ec-8f28-9ea3d041a96f" acquired by "delete_volume" :: waited 0.015s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:59:28 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5d5e7f-d388-45e7-b7bb-a663d46f55cf]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:59:28 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f3dd4eff-69cd-420d-a91e-4afc8ae6e885 tempest-ProjectReaderTests-794640156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-41c7b73d-6a99-48ec-8f28-9ea3d041a96f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:28 devstack sudo[115674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-41c7b73d-6a99-48ec-8f28-9ea3d041a96f Aug 27 03:59:28 devstack sudo[115674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:29 devstack sudo[115674]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f3dd4eff-69cd-420d-a91e-4afc8ae6e885 tempest-ProjectReaderTests-794640156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-41c7b73d-6a99-48ec-8f28-9ea3d041a96f" returned: 0 in 0.345s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f3dd4eff-69cd-420d-a91e-4afc8ae6e885 tempest-ProjectReaderTests-794640156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-41c7b73d-6a99-48ec-8f28-9ea3d041a96f {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:29 devstack sudo[115679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-41c7b73d-6a99-48ec-8f28-9ea3d041a96f Aug 27 03:59:29 devstack sudo[115679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:29 devstack sudo[115679]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f3dd4eff-69cd-420d-a91e-4afc8ae6e885 tempest-ProjectReaderTests-794640156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-41c7b73d-6a99-48ec-8f28-9ea3d041a96f" returned: 0 in 0.235s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f3dd4eff-69cd-420d-a91e-4afc8ae6e885 tempest-ProjectReaderTests-794640156 None] Lock "cinder-quobyte-41c7b73d-6a99-48ec-8f28-9ea3d041a96f" released by "delete_volume" :: held 0.619s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:59:29 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-f3dd4eff-69cd-420d-a91e-4afc8ae6e885 tempest-ProjectReaderTests-794640156 None] Created reservations ['37b21738-b89b-479c-85e0-89dbf259c7bb', 'c5740fee-b35c-4394-9951-f54e803f43c7', 'd9bf9eb4-d4a3-4b90-a3eb-1dcbfea61907', 'ca608744-c1ee-406b-b312-3fe5da239f3b'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:59:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f3dd4eff-69cd-420d-a91e-4afc8ae6e885 tempest-ProjectReaderTests-794640156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f3dd4eff-69cd-420d-a91e-4afc8ae6e885 tempest-ProjectReaderTests-794640156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f3dd4eff-69cd-420d-a91e-4afc8ae6e885 tempest-ProjectReaderTests-794640156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:59:29 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f3dd4eff-69cd-420d-a91e-4afc8ae6e885 tempest-ProjectReaderTests-794640156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:59:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f3dd4eff-69cd-420d-a91e-4afc8ae6e885 tempest-ProjectReaderTests-794640156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f3dd4eff-69cd-420d-a91e-4afc8ae6e885 tempest-ProjectReaderTests-794640156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:29 devstack sudo[115682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:59:29 devstack sudo[115682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:29 devstack sudo[115682]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:29 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f3dd4eff-69cd-420d-a91e-4afc8ae6e885 tempest-ProjectReaderTests-794640156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.246s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:29 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-f3dd4eff-69cd-420d-a91e-4afc8ae6e885 tempest-ProjectReaderTests-794640156 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:59:29 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f3dd4eff-69cd-420d-a91e-4afc8ae6e885 tempest-ProjectReaderTests-794640156 None] Deleted volume successfully. Aug 27 03:59:29 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f3dd4eff-69cd-420d-a91e-4afc8ae6e885 tempest-ProjectReaderTests-794640156 None] Lock "cinder-41c7b73d-6a99-48ec-8f28-9ea3d041a96f-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Flow 'volume_create_manager' (5e726809-756c-48f1-a1dd-2ac6767dac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ff1565-013e-465b-a5b7-5738bcb66d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ff1565-013e-465b-a5b7-5738bcb66d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1251334731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c12786d-6c39-4eac-932b-e7c95be94677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216f8fb9605d4475af4a58dab13404d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:59:30Z,use_quota=True,user_id='80ea3f9946d54f48be2bc2ce31d0d75d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fcbcb9c-7b14-485b-ba07-7d0947cfc57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fcbcb9c-7b14-485b-ba07-7d0947cfc57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e56120-a6a9-4a3c-9688-09c391083462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e56120-a6a9-4a3c-9688-09c391083462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c12786d-6c39-4eac-932b-e7c95be94677', 'volume_name': 'volume-9c12786d-6c39-4eac-932b-e7c95be94677', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61228a31-7cb3-4615-a769-66a4babcd905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61228a31-7cb3-4615-a769-66a4babcd905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554d474d-21ee-4496-879a-8176f12ef444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:30 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Volume 9c12786d-6c39-4eac-932b-e7c95be94677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c12786d-6c39-4eac-932b-e7c95be94677', 'volume_size': 1} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1251334731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c12786d-6c39-4eac-932b-e7c95be94677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216f8fb9605d4475af4a58dab13404d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:59:30Z,use_quota=True,user_id='80ea3f9946d54f48be2bc2ce31d0d75d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Creating volume 9c12786d-6c39-4eac-932b-e7c95be94677 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:59:30 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9c12786d-6c39-4eac-932b-e7c95be94677 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:30 devstack sudo[115685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9c12786d-6c39-4eac-932b-e7c95be94677 1073741824 Aug 27 03:59:30 devstack sudo[115685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:30 devstack sudo[115685]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9c12786d-6c39-4eac-932b-e7c95be94677 1073741824" returned: 0 in 0.391s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9c12786d-6c39-4eac-932b-e7c95be94677 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:30 devstack sudo[115690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9c12786d-6c39-4eac-932b-e7c95be94677 Aug 27 03:59:30 devstack sudo[115690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:30 devstack sudo[115690]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9c12786d-6c39-4eac-932b-e7c95be94677" returned: 0 in 0.234s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554d474d-21ee-4496-879a-8176f12ef444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c12786d-6c39-4eac-932b-e7c95be94677', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3af5b71-9f23-4dd4-a2f7-2e5aa8c2c6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:30 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Volume volume-9c12786d-6c39-4eac-932b-e7c95be94677 (9c12786d-6c39-4eac-932b-e7c95be94677): created successfully Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3af5b71-9f23-4dd4-a2f7-2e5aa8c2c6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:30 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Flow 'volume_create_manager' (5e726809-756c-48f1-a1dd-2ac6767dac51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:59:30 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-7dc0d3d6-9666-45dc-9b36-1fb0b1c9d9b0 tempest-ProjectReaderTests-794640156 None] Created volume successfully. Aug 27 03:59:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d77ec58c-d9af-478e-9631-247eb59a164c tempest-ProjectReaderTests-794640156 None] Acquiring lock "cinder-9c12786d-6c39-4eac-932b-e7c95be94677-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:59:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d77ec58c-d9af-478e-9631-247eb59a164c tempest-ProjectReaderTests-794640156 None] Lock "cinder-9c12786d-6c39-4eac-932b-e7c95be94677-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:59:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d77ec58c-d9af-478e-9631-247eb59a164c tempest-ProjectReaderTests-794640156 None] Acquiring lock "cinder-quobyte-9c12786d-6c39-4eac-932b-e7c95be94677" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:59:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d77ec58c-d9af-478e-9631-247eb59a164c tempest-ProjectReaderTests-794640156 None] Lock "cinder-quobyte-9c12786d-6c39-4eac-932b-e7c95be94677" acquired by "delete_volume" :: waited 0.014s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:59:31 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1999664-f45a-47b7-b60a-0e76371e521b]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:59:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d77ec58c-d9af-478e-9631-247eb59a164c tempest-ProjectReaderTests-794640156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9c12786d-6c39-4eac-932b-e7c95be94677 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:31 devstack sudo[115693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9c12786d-6c39-4eac-932b-e7c95be94677 Aug 27 03:59:31 devstack sudo[115693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:31 devstack sudo[115693]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d77ec58c-d9af-478e-9631-247eb59a164c tempest-ProjectReaderTests-794640156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9c12786d-6c39-4eac-932b-e7c95be94677" returned: 0 in 0.352s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d77ec58c-d9af-478e-9631-247eb59a164c tempest-ProjectReaderTests-794640156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9c12786d-6c39-4eac-932b-e7c95be94677 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:31 devstack sudo[115698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9c12786d-6c39-4eac-932b-e7c95be94677 Aug 27 03:59:31 devstack sudo[115698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:31 devstack sudo[115698]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:31 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d77ec58c-d9af-478e-9631-247eb59a164c tempest-ProjectReaderTests-794640156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-9c12786d-6c39-4eac-932b-e7c95be94677" returned: 0 in 0.254s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:31 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d77ec58c-d9af-478e-9631-247eb59a164c tempest-ProjectReaderTests-794640156 None] Lock "cinder-quobyte-9c12786d-6c39-4eac-932b-e7c95be94677" released by "delete_volume" :: held 0.643s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:59:31 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-d77ec58c-d9af-478e-9631-247eb59a164c tempest-ProjectReaderTests-794640156 None] Created reservations ['cf9ee750-84cc-4275-831d-efb6e66c868f', 'fa5e472b-19fd-4834-be30-a1b8e89a7847', 'b3c3005d-8f5c-4a6d-9e4b-240d4ef54fcd', 'f389b1b5-e543-4669-92a0-b4c2746448b4'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d77ec58c-d9af-478e-9631-247eb59a164c tempest-ProjectReaderTests-794640156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d77ec58c-d9af-478e-9631-247eb59a164c tempest-ProjectReaderTests-794640156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d77ec58c-d9af-478e-9631-247eb59a164c tempest-ProjectReaderTests-794640156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-d77ec58c-d9af-478e-9631-247eb59a164c tempest-ProjectReaderTests-794640156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-d77ec58c-d9af-478e-9631-247eb59a164c tempest-ProjectReaderTests-794640156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d77ec58c-d9af-478e-9631-247eb59a164c tempest-ProjectReaderTests-794640156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:32 devstack sudo[115701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:59:32 devstack sudo[115701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:32 devstack sudo[115701]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-d77ec58c-d9af-478e-9631-247eb59a164c tempest-ProjectReaderTests-794640156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.260s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-d77ec58c-d9af-478e-9631-247eb59a164c tempest-ProjectReaderTests-794640156 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:59:32 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-d77ec58c-d9af-478e-9631-247eb59a164c tempest-ProjectReaderTests-794640156 None] Deleted volume successfully. Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-d77ec58c-d9af-478e-9631-247eb59a164c tempest-ProjectReaderTests-794640156 None] Lock "cinder-9c12786d-6c39-4eac-932b-e7c95be94677-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Flow 'volume_create_manager' (cf579090-52f1-478d-9a2f-650d874aec51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26269902-233b-4ab7-b1e8-f7c35cf826fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26269902-233b-4ab7-b1e8-f7c35cf826fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1103269940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271be4c7-c4da-4739-a250-857c2f37b923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216f8fb9605d4475af4a58dab13404d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:59:33Z,use_quota=True,user_id='80ea3f9946d54f48be2bc2ce31d0d75d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ea4155-b658-4305-8b8d-33156b52220e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ea4155-b658-4305-8b8d-33156b52220e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e486ae2-0d4d-47db-8b64-d3925db3fef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e486ae2-0d4d-47db-8b64-d3925db3fef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '271be4c7-c4da-4739-a250-857c2f37b923', 'volume_name': 'volume-271be4c7-c4da-4739-a250-857c2f37b923', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4430a80-1cc4-4259-acf3-1c65acc21166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4430a80-1cc4-4259-acf3-1c65acc21166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9848b41b-36b7-4ece-9bf4-18405203aa5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:32 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Volume 271be4c7-c4da-4739-a250-857c2f37b923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-271be4c7-c4da-4739-a250-857c2f37b923', 'volume_size': 1} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1103269940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271be4c7-c4da-4739-a250-857c2f37b923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216f8fb9605d4475af4a58dab13404d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:59:33Z,use_quota=True,user_id='80ea3f9946d54f48be2bc2ce31d0d75d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Creating volume 271be4c7-c4da-4739-a250-857c2f37b923 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:59:32 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:59:32 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-271be4c7-c4da-4739-a250-857c2f37b923 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:32 devstack sudo[115704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-271be4c7-c4da-4739-a250-857c2f37b923 1073741824 Aug 27 03:59:32 devstack sudo[115704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:33 devstack sudo[115704]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-271be4c7-c4da-4739-a250-857c2f37b923 1073741824" returned: 0 in 0.407s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-271be4c7-c4da-4739-a250-857c2f37b923 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:33 devstack sudo[115709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-271be4c7-c4da-4739-a250-857c2f37b923 Aug 27 03:59:33 devstack sudo[115709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:33 devstack sudo[115709]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-271be4c7-c4da-4739-a250-857c2f37b923" returned: 0 in 0.233s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:33 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:59:33 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9848b41b-36b7-4ece-9bf4-18405203aa5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-271be4c7-c4da-4739-a250-857c2f37b923', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863e7c93-a383-453f-bc84-acce4dffb34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:33 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Volume volume-271be4c7-c4da-4739-a250-857c2f37b923 (271be4c7-c4da-4739-a250-857c2f37b923): created successfully Aug 27 03:59:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863e7c93-a383-453f-bc84-acce4dffb34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:33 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Flow 'volume_create_manager' (cf579090-52f1-478d-9a2f-650d874aec51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:59:33 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-2290d996-cc7b-43a5-81cd-c8741f42a3b8 tempest-ProjectReaderTests-794640156 None] Created volume successfully. Aug 27 03:59:33 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-af234240-ab6e-4414-8c01-fc3009d7cdd7 tempest-ProjectReaderTests-794640156 None] Acquiring lock "cinder-271be4c7-c4da-4739-a250-857c2f37b923-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:59:33 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-af234240-ab6e-4414-8c01-fc3009d7cdd7 tempest-ProjectReaderTests-794640156 None] Lock "cinder-271be4c7-c4da-4739-a250-857c2f37b923-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:59:33 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-af234240-ab6e-4414-8c01-fc3009d7cdd7 tempest-ProjectReaderTests-794640156 None] Acquiring lock "cinder-quobyte-271be4c7-c4da-4739-a250-857c2f37b923" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:59:33 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-af234240-ab6e-4414-8c01-fc3009d7cdd7 tempest-ProjectReaderTests-794640156 None] Lock "cinder-quobyte-271be4c7-c4da-4739-a250-857c2f37b923" acquired by "delete_volume" :: waited 0.013s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:59:34 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c05cbe5-e2a0-4f9d-a40b-695993c5f6d1]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:59:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-af234240-ab6e-4414-8c01-fc3009d7cdd7 tempest-ProjectReaderTests-794640156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-271be4c7-c4da-4739-a250-857c2f37b923 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:34 devstack sudo[115713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-271be4c7-c4da-4739-a250-857c2f37b923 Aug 27 03:59:34 devstack sudo[115713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:34 devstack sudo[115713]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-af234240-ab6e-4414-8c01-fc3009d7cdd7 tempest-ProjectReaderTests-794640156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-271be4c7-c4da-4739-a250-857c2f37b923" returned: 0 in 0.355s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-af234240-ab6e-4414-8c01-fc3009d7cdd7 tempest-ProjectReaderTests-794640156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-271be4c7-c4da-4739-a250-857c2f37b923 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:34 devstack sudo[115718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-271be4c7-c4da-4739-a250-857c2f37b923 Aug 27 03:59:34 devstack sudo[115718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:34 devstack sudo[115718]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-af234240-ab6e-4414-8c01-fc3009d7cdd7 tempest-ProjectReaderTests-794640156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-271be4c7-c4da-4739-a250-857c2f37b923" returned: 0 in 0.246s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-af234240-ab6e-4414-8c01-fc3009d7cdd7 tempest-ProjectReaderTests-794640156 None] Lock "cinder-quobyte-271be4c7-c4da-4739-a250-857c2f37b923" released by "delete_volume" :: held 0.637s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:59:34 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-af234240-ab6e-4414-8c01-fc3009d7cdd7 tempest-ProjectReaderTests-794640156 None] Created reservations ['ae732b21-a31d-448c-809e-68a99fa0add7', 'd541d4d3-4ab5-44f6-849c-f79334b9e09d', '5c648199-7fcf-43df-ab21-ad35437c7bbb', 'd53a5b21-401f-4528-8981-e3306152f842'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:59:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-af234240-ab6e-4414-8c01-fc3009d7cdd7 tempest-ProjectReaderTests-794640156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-af234240-ab6e-4414-8c01-fc3009d7cdd7 tempest-ProjectReaderTests-794640156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-af234240-ab6e-4414-8c01-fc3009d7cdd7 tempest-ProjectReaderTests-794640156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:59:34 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-af234240-ab6e-4414-8c01-fc3009d7cdd7 tempest-ProjectReaderTests-794640156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:59:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-af234240-ab6e-4414-8c01-fc3009d7cdd7 tempest-ProjectReaderTests-794640156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-af234240-ab6e-4414-8c01-fc3009d7cdd7 tempest-ProjectReaderTests-794640156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:34 devstack sudo[115721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:59:34 devstack sudo[115721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:34 devstack sudo[115721]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:34 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-af234240-ab6e-4414-8c01-fc3009d7cdd7 tempest-ProjectReaderTests-794640156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.232s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:34 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-af234240-ab6e-4414-8c01-fc3009d7cdd7 tempest-ProjectReaderTests-794640156 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:59:34 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-af234240-ab6e-4414-8c01-fc3009d7cdd7 tempest-ProjectReaderTests-794640156 None] Deleted volume successfully. Aug 27 03:59:34 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-af234240-ab6e-4414-8c01-fc3009d7cdd7 tempest-ProjectReaderTests-794640156 None] Lock "cinder-271be4c7-c4da-4739-a250-857c2f37b923-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:59:35 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:59:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Flow 'volume_create_manager' (488b7cd8-da03-4bb5-8d1a-38c4893e4828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:59:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57897350-87d1-4c1d-a705-d43ec3f19bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57897350-87d1-4c1d-a705-d43ec3f19bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1674471828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54ddc8f-e879-44e2-a834-ac34808bf1e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216f8fb9605d4475af4a58dab13404d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:59:35Z,use_quota=True,user_id='80ea3f9946d54f48be2bc2ce31d0d75d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63ea76c-3a52-4e36-b146-3785a0ed09e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63ea76c-3a52-4e36-b146-3785a0ed09e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79bb6d7f-3f91-4898-9493-03aa1caab462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79bb6d7f-3f91-4898-9493-03aa1caab462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e54ddc8f-e879-44e2-a834-ac34808bf1e9', 'volume_name': 'volume-e54ddc8f-e879-44e2-a834-ac34808bf1e9', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44aa8e36-a35f-4146-96ef-f0a8e5c732b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44aa8e36-a35f-4146-96ef-f0a8e5c732b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:35 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a52c895-daee-491f-b935-edf3261f4093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:35 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Volume e54ddc8f-e879-44e2-a834-ac34808bf1e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e54ddc8f-e879-44e2-a834-ac34808bf1e9', 'volume_size': 1} Aug 27 03:59:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1674471828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54ddc8f-e879-44e2-a834-ac34808bf1e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='216f8fb9605d4475af4a58dab13404d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:59:35Z,use_quota=True,user_id='80ea3f9946d54f48be2bc2ce31d0d75d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:59:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Creating volume e54ddc8f-e879-44e2-a834-ac34808bf1e9 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:59:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:59:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:59:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:35 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:59:35 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:59:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e54ddc8f-e879-44e2-a834-ac34808bf1e9 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:35 devstack sudo[115724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e54ddc8f-e879-44e2-a834-ac34808bf1e9 1073741824 Aug 27 03:59:35 devstack sudo[115724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:35 devstack sudo[115724]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:35 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e54ddc8f-e879-44e2-a834-ac34808bf1e9 1073741824" returned: 0 in 0.399s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e54ddc8f-e879-44e2-a834-ac34808bf1e9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:36 devstack sudo[115729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e54ddc8f-e879-44e2-a834-ac34808bf1e9 Aug 27 03:59:36 devstack sudo[115729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:36 devstack sudo[115729]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e54ddc8f-e879-44e2-a834-ac34808bf1e9" returned: 0 in 0.241s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:36 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:59:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a52c895-daee-491f-b935-edf3261f4093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e54ddc8f-e879-44e2-a834-ac34808bf1e9', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a66fcbf2-a3a6-4aaf-8599-253d51d40f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:36 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Volume volume-e54ddc8f-e879-44e2-a834-ac34808bf1e9 (e54ddc8f-e879-44e2-a834-ac34808bf1e9): created successfully Aug 27 03:59:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a66fcbf2-a3a6-4aaf-8599-253d51d40f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:36 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Flow 'volume_create_manager' (488b7cd8-da03-4bb5-8d1a-38c4893e4828) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:59:36 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-7e24680b-47e2-4e58-8636-3381f1ed9b6e tempest-ProjectReaderTests-794640156 None] Created volume successfully. Aug 27 03:59:36 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0cc62269-760c-4326-a45e-34ae66ed8397 tempest-ProjectReaderTests-794640156 None] Acquiring lock "cinder-e54ddc8f-e879-44e2-a834-ac34808bf1e9-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:59:36 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0cc62269-760c-4326-a45e-34ae66ed8397 tempest-ProjectReaderTests-794640156 None] Lock "cinder-e54ddc8f-e879-44e2-a834-ac34808bf1e9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:59:36 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0cc62269-760c-4326-a45e-34ae66ed8397 tempest-ProjectReaderTests-794640156 None] Acquiring lock "cinder-quobyte-e54ddc8f-e879-44e2-a834-ac34808bf1e9" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 03:59:36 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0cc62269-760c-4326-a45e-34ae66ed8397 tempest-ProjectReaderTests-794640156 None] Lock "cinder-quobyte-e54ddc8f-e879-44e2-a834-ac34808bf1e9" acquired by "delete_volume" :: waited 0.013s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 03:59:36 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[a666248b-b151-42b8-b6d4-d504faaa74ef]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:59:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0cc62269-760c-4326-a45e-34ae66ed8397 tempest-ProjectReaderTests-794640156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e54ddc8f-e879-44e2-a834-ac34808bf1e9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:36 devstack sudo[115732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e54ddc8f-e879-44e2-a834-ac34808bf1e9 Aug 27 03:59:36 devstack sudo[115732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:36 devstack sudo[115732]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0cc62269-760c-4326-a45e-34ae66ed8397 tempest-ProjectReaderTests-794640156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e54ddc8f-e879-44e2-a834-ac34808bf1e9" returned: 0 in 0.356s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:36 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0cc62269-760c-4326-a45e-34ae66ed8397 tempest-ProjectReaderTests-794640156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e54ddc8f-e879-44e2-a834-ac34808bf1e9 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:36 devstack sudo[115737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e54ddc8f-e879-44e2-a834-ac34808bf1e9 Aug 27 03:59:36 devstack sudo[115737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:37 devstack sudo[115737]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0cc62269-760c-4326-a45e-34ae66ed8397 tempest-ProjectReaderTests-794640156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-e54ddc8f-e879-44e2-a834-ac34808bf1e9" returned: 0 in 0.234s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0cc62269-760c-4326-a45e-34ae66ed8397 tempest-ProjectReaderTests-794640156 None] Lock "cinder-quobyte-e54ddc8f-e879-44e2-a834-ac34808bf1e9" released by "delete_volume" :: held 0.625s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:59:37 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-0cc62269-760c-4326-a45e-34ae66ed8397 tempest-ProjectReaderTests-794640156 None] Created reservations ['16513f0f-f51c-4522-8a71-4e994fb23e91', '4f9abae3-82af-433c-ab19-c14e2fad072d', '4580f5a9-3ae1-4b94-849f-be8cf9a319cb', '18e9f9da-0e43-4319-9627-55926c13af2a'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 03:59:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0cc62269-760c-4326-a45e-34ae66ed8397 tempest-ProjectReaderTests-794640156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0cc62269-760c-4326-a45e-34ae66ed8397 tempest-ProjectReaderTests-794640156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0cc62269-760c-4326-a45e-34ae66ed8397 tempest-ProjectReaderTests-794640156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:59:37 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-0cc62269-760c-4326-a45e-34ae66ed8397 tempest-ProjectReaderTests-794640156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:59:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-0cc62269-760c-4326-a45e-34ae66ed8397 tempest-ProjectReaderTests-794640156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0cc62269-760c-4326-a45e-34ae66ed8397 tempest-ProjectReaderTests-794640156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:37 devstack sudo[115740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 03:59:37 devstack sudo[115740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:37 devstack sudo[115740]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:37 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-0cc62269-760c-4326-a45e-34ae66ed8397 tempest-ProjectReaderTests-794640156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.248s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:37 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-0cc62269-760c-4326-a45e-34ae66ed8397 tempest-ProjectReaderTests-794640156 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 03:59:37 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-0cc62269-760c-4326-a45e-34ae66ed8397 tempest-ProjectReaderTests-794640156 None] Deleted volume successfully. Aug 27 03:59:37 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-0cc62269-760c-4326-a45e-34ae66ed8397 tempest-ProjectReaderTests-794640156 None] Lock "cinder-e54ddc8f-e879-44e2-a834-ac34808bf1e9-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 03:59:47 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=31,cinder:UPDATE=40,cinder:DELETE=3,cinder:INSERT=11 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:59:47 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=24,cinder:UPDATE=47,cinder:INSERT=9,cinder:DELETE=5 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 03:59:56 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 03:59:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Flow 'volume_create_manager' (d8d9f017-b7f5-430f-86be-5e106a30580d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:59:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac87744-35d2-492a-91fc-1e6df1f7975f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac87744-35d2-492a-91fc-1e6df1f7975f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-269934925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eca6b3b-c91a-404b-b00f-efaf80450660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef5940fcc524bdca4be3673837bc66d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:59:57Z,use_quota=True,user_id='7b5010d28dd844eb92d4567c498347d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a8a551-5d81-4f6e-bf06-84b06e21e00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a8a551-5d81-4f6e-bf06-84b06e21e00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa30a004-0eee-4f98-a3c5-936d9f0367e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa30a004-0eee-4f98-a3c5-936d9f0367e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eca6b3b-c91a-404b-b00f-efaf80450660', 'volume_name': 'volume-3eca6b3b-c91a-404b-b00f-efaf80450660', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:56 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feca3413-35fc-4af8-95c4-520072597afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feca3413-35fc-4af8-95c4-520072597afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5480dc82-64ab-4a41-b326-a453cf3947d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:57 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Volume 3eca6b3b-c91a-404b-b00f-efaf80450660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eca6b3b-c91a-404b-b00f-efaf80450660', 'volume_size': 1} Aug 27 03:59:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T01:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-269934925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eca6b3b-c91a-404b-b00f-efaf80450660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef5940fcc524bdca4be3673837bc66d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T01:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T01:59:57Z,use_quota=True,user_id='7b5010d28dd844eb92d4567c498347d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)}" {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 27 03:59:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Creating volume 3eca6b3b-c91a-404b-b00f-efaf80450660 {{(pid=94328) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 27 03:59:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 03:59:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 03:59:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 03:59:57 devstack cinder-volume[94328]: INFO cinder.volume.drivers.remotefs [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] casted to osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac Aug 27 03:59:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660 1073741824 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:57 devstack sudo[115747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660 1073741824 Aug 27 03:59:57 devstack sudo[115747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:57 devstack sudo[115747]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660 1073741824" returned: 0 in 0.454s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:57 devstack sudo[115753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660 Aug 27 03:59:57 devstack sudo[115753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:57 devstack sudo[115753]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660" returned: 0 in 0.237s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:57 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'} {{(pid=94328) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 27 03:59:57 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5480dc82-64ab-4a41-b326-a453cf3947d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eca6b3b-c91a-404b-b00f-efaf80450660', 'volume_size': 1}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d055d49-3a70-4b21-8043-5d79ad53a7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 03:59:57 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Volume volume-3eca6b3b-c91a-404b-b00f-efaf80450660 (3eca6b3b-c91a-404b-b00f-efaf80450660): created successfully Aug 27 03:59:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d055d49-3a70-4b21-8043-5d79ad53a7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 03:59:57 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Flow 'volume_create_manager' (d8d9f017-b7f5-430f-86be-5e106a30580d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 03:59:57 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-63e2ee2a-4115-4811-a8ab-c2d5adcaec8b tempest-SnapshotDependencyTests-1456083819 None] Created volume successfully. Aug 27 03:59:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fd3b1e43-83be-4e06-94b2-ba9aa45687aa tempest-SnapshotDependencyTests-1456083819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 03:59:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fd3b1e43-83be-4e06-94b2-ba9aa45687aa tempest-SnapshotDependencyTests-1456083819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 03:59:58 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-fd3b1e43-83be-4e06-94b2-ba9aa45687aa tempest-SnapshotDependencyTests-1456083819 None] Creating offline snapshot e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc of volume 3eca6b3b-c91a-404b-b00f-efaf80450660 {{(pid=94328) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 27 03:59:58 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2bedd6-220f-4789-a77f-7a5507c2ce7d]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 03:59:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fd3b1e43-83be-4e06-94b2-ba9aa45687aa tempest-SnapshotDependencyTests-1456083819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:58 devstack sudo[115756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660 Aug 27 03:59:58 devstack sudo[115756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:58 devstack sudo[115756]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fd3b1e43-83be-4e06-94b2-ba9aa45687aa tempest-SnapshotDependencyTests-1456083819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660" returned: 0 in 0.347s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fd3b1e43-83be-4e06-94b2-ba9aa45687aa tempest-SnapshotDependencyTests-1456083819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc 1G {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:58 devstack sudo[115761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc 1G Aug 27 03:59:58 devstack sudo[115761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:58 devstack sudo[115761]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fd3b1e43-83be-4e06-94b2-ba9aa45687aa tempest-SnapshotDependencyTests-1456083819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc 1G" returned: 0 in 0.362s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:58 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fd3b1e43-83be-4e06-94b2-ba9aa45687aa tempest-SnapshotDependencyTests-1456083819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eca6b3b-c91a-404b-b00f-efaf80450660 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:58 devstack sudo[115766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eca6b3b-c91a-404b-b00f-efaf80450660 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc Aug 27 03:59:58 devstack sudo[115766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:59 devstack sudo[115766]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fd3b1e43-83be-4e06-94b2-ba9aa45687aa tempest-SnapshotDependencyTests-1456083819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eca6b3b-c91a-404b-b00f-efaf80450660 -F qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc" returned: 0 in 0.270s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:59 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-fd3b1e43-83be-4e06-94b2-ba9aa45687aa tempest-SnapshotDependencyTests-1456083819 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc is being set with open permissions: ugo+rw Aug 27 03:59:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fd3b1e43-83be-4e06-94b2-ba9aa45687aa tempest-SnapshotDependencyTests-1456083819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:59 devstack sudo[115771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc Aug 27 03:59:59 devstack sudo[115771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:59 devstack sudo[115771]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fd3b1e43-83be-4e06-94b2-ba9aa45687aa tempest-SnapshotDependencyTests-1456083819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc" returned: 0 in 0.229s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fd3b1e43-83be-4e06-94b2-ba9aa45687aa tempest-SnapshotDependencyTests-1456083819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:59 devstack sudo[115774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.info Aug 27 03:59:59 devstack sudo[115774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:59 devstack sudo[115774]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fd3b1e43-83be-4e06-94b2-ba9aa45687aa tempest-SnapshotDependencyTests-1456083819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.info" returned: 0 in 0.234s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:59 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-fd3b1e43-83be-4e06-94b2-ba9aa45687aa tempest-SnapshotDependencyTests-1456083819 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.info is being set with open permissions: ugo+rw Aug 27 03:59:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fd3b1e43-83be-4e06-94b2-ba9aa45687aa tempest-SnapshotDependencyTests-1456083819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.info {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 03:59:59 devstack sudo[115777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.info Aug 27 03:59:59 devstack sudo[115777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 03:59:59 devstack sudo[115777]: pam_unix(sudo:session): session closed for user root Aug 27 03:59:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-fd3b1e43-83be-4e06-94b2-ba9aa45687aa tempest-SnapshotDependencyTests-1456083819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.info" returned: 0 in 0.227s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 03:59:59 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-fd3b1e43-83be-4e06-94b2-ba9aa45687aa tempest-SnapshotDependencyTests-1456083819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.746s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 03:59:59 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-fd3b1e43-83be-4e06-94b2-ba9aa45687aa tempest-SnapshotDependencyTests-1456083819 None] Create snapshot completed successfully Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94328) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Flow 'volume_create_manager' (17444d8a-336e-43e4-bb69-4b7927194c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b666fe6-826f-445c-a8cc-dd70c6c5a15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b666fe6-826f-445c-a8cc-dd70c6c5a15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-27T02:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef5940fcc524bdca4be3673837bc66d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-27T02:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-27T02:00:01Z,use_quota=True,user_id='7b5010d28dd844eb92d4567c498347d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a03b90ab-bc78-4365-b4ee-9cd7c1e84194),volume_type_id=a03b90ab-bc78-4365-b4ee-9cd7c1e84194)' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65787f49-b95e-4a15-8bc5-57f0c1540f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65787f49-b95e-4a15-8bc5-57f0c1540f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a70329-8320-490b-b394-8b1852ae9a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a70329-8320-490b-b394-8b1852ae9a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5', 'volume_name': 'volume-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5', 'volume_size': 1, 'snapshot_id': 'e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc'}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (366bced5-25de-4058-a3db-9f89724484b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (366bced5-25de-4058-a3db-9f89724484b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4648c63-759a-4ffa-aa11-e8ac10c23c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 04:00:00 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Volume fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5', 'volume_size': 1, 'snapshot_id': 'e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc'} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Acquiring lock "cinder-quobyte-e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5" by "_create_volume_from_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Lock "cinder-quobyte-e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Creating volume fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5 from snapshot e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc {{(pid=94328) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Selected osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac as target Quobyte volume. {{(pid=94328) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Acquiring lock "cinder-quobyte-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5" by "_copy_volume_from_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Lock "cinder-quobyte-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] snapshot: e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc, volume: fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5, {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe429b3-22f5-4723-9cfb-d43a1733bcf3]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 04:00:00 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 04:00:01 devstack sudo[115781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc Aug 27 04:00:01 devstack sudo[115781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 04:00:01 devstack sudo[115781]: pam_unix(sudo:session): session closed for user root Aug 27 04:00:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc" returned: 0 in 0.338s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 04:00:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3eca6b3b-c91a-404b-b00f-efaf80450660(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 04:00:01 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcd7472-10d6-4df8-a4b5-eb2fc2269549]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 04:00:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 04:00:01 devstack sudo[115786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660 Aug 27 04:00:01 devstack sudo[115786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 04:00:01 devstack sudo[115786]: pam_unix(sudo:session): session closed for user root Aug 27 04:00:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660" returned: 0 in 0.338s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 04:00:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] will copy from snapshot at /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660 {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 27 04:00:01 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Creating direct copy from snapshot {{(pid=94328) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 27 04:00:01 devstack cinder-volume[94328]: DEBUG cinder.utils [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Path /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5 not found in is_blk_device check {{(pid=94328) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 27 04:00:01 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 04:00:01 devstack sudo[115791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5 Aug 27 04:00:01 devstack sudo[115791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 04:00:05 devstack sudo[115791]: pam_unix(sudo:session): session closed for user root Aug 27 04:00:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5" returned: 0 in 3.842s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 04:00:05 devstack cinder-volume[94328]: DEBUG cinder.image.image_utils [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Image conversion details: src /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660, size 1024.00 MB, duration 3.84 sec, destination /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5 {{(pid=94328) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 27 04:00:05 devstack cinder-volume[94328]: INFO cinder.image.image_utils [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Converted 1024.00 MB image at 266.41 MB/s Aug 27 04:00:05 devstack cinder-volume[94328]: WARNING cinder.volume.drivers.remotefs [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5 is being set with open permissions: ugo+rw Aug 27 04:00:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 04:00:05 devstack sudo[115807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5 Aug 27 04:00:05 devstack sudo[115807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 04:00:05 devstack sudo[115807]: pam_unix(sudo:session): session closed for user root Aug 27 04:00:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5" returned: 0 in 0.250s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 04:00:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Lock "cinder-quobyte-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5" released by "_copy_volume_from_snapshot" :: held 4.837s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 04:00:05 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Lock "cinder-quobyte-e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5" released by "_create_volume_from_snapshot" :: held 4.892s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 04:00:05 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.908s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 04:00:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4648c63-759a-4ffa-aa11-e8ac10c23c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5', 'volume_size': 1, 'snapshot_id': 'e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc'}' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 04:00:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf4dae16-013a-445b-bd97-05de2eb148b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 27 04:00:05 devstack cinder-volume[94328]: INFO cinder.volume.flows.manager.create_volume [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Volume volume-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5 (fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5): created successfully Aug 27 04:00:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf4dae16-013a-445b-bd97-05de2eb148b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94328) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 27 04:00:05 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Flow 'volume_create_manager' (17444d8a-336e-43e4-bb69-4b7927194c92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94328) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 27 04:00:05 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f2ff6ea1-6a53-4e8f-b388-600569967545 tempest-SnapshotDependencyTests-1456083819 None] Created volume successfully. Aug 27 04:00:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f2b7a660-ed5d-4560-a725-1f15847ae713 tempest-SnapshotDependencyTests-1456083819 None] Acquiring lock "cinder-e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc-delete_snapshot" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 04:00:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f2b7a660-ed5d-4560-a725-1f15847ae713 tempest-SnapshotDependencyTests-1456083819 None] Lock "cinder-e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 04:00:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f2b7a660-ed5d-4560-a725-1f15847ae713 tempest-SnapshotDependencyTests-1456083819 None] Acquiring lock "cinder-quobyte-3eca6b3b-c91a-404b-b00f-efaf80450660" by "delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 04:00:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f2b7a660-ed5d-4560-a725-1f15847ae713 tempest-SnapshotDependencyTests-1456083819 None] Lock "cinder-quobyte-3eca6b3b-c91a-404b-b00f-efaf80450660" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 04:00:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f2b7a660-ed5d-4560-a725-1f15847ae713 tempest-SnapshotDependencyTests-1456083819 None] Acquiring lock "cinder-quobyte-e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc" by "_delete_snapshot" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 04:00:06 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f2b7a660-ed5d-4560-a725-1f15847ae713 tempest-SnapshotDependencyTests-1456083819 None] Lock "cinder-quobyte-e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 04:00:06 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-f2b7a660-ed5d-4560-a725-1f15847ae713 tempest-SnapshotDependencyTests-1456083819 None] Deleting offline snapshot e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc of volume 3eca6b3b-c91a-404b-b00f-efaf80450660 {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 27 04:00:06 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-f2b7a660-ed5d-4560-a725-1f15847ae713 tempest-SnapshotDependencyTests-1456083819 None] snapshot_file for this snap is: volume-3eca6b3b-c91a-404b-b00f-efaf80450660.e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc {{(pid=94328) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 27 04:00:06 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8f536c-788f-4111-afb7-aa94b5d53df3]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 04:00:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2b7a660-ed5d-4560-a725-1f15847ae713 tempest-SnapshotDependencyTests-1456083819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 04:00:06 devstack sudo[115810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc Aug 27 04:00:06 devstack sudo[115810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 04:00:06 devstack sudo[115810]: pam_unix(sudo:session): session closed for user root Aug 27 04:00:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2b7a660-ed5d-4560-a725-1f15847ae713 tempest-SnapshotDependencyTests-1456083819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc" returned: 0 in 0.345s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 04:00:06 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.remotefs [None req-f2b7a660-ed5d-4560-a725-1f15847ae713 tempest-SnapshotDependencyTests-1456083819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3eca6b3b-c91a-404b-b00f-efaf80450660(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94328) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 27 04:00:06 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfebf7e9-b6cd-4349-9b03-3c1121a6ebd9]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 04:00:06 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2b7a660-ed5d-4560-a725-1f15847ae713 tempest-SnapshotDependencyTests-1456083819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 04:00:06 devstack sudo[115815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660 Aug 27 04:00:06 devstack sudo[115815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 04:00:07 devstack sudo[115815]: pam_unix(sudo:session): session closed for user root Aug 27 04:00:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2b7a660-ed5d-4560-a725-1f15847ae713 tempest-SnapshotDependencyTests-1456083819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660" returned: 0 in 0.514s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 04:00:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2b7a660-ed5d-4560-a725-1f15847ae713 tempest-SnapshotDependencyTests-1456083819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 04:00:07 devstack sudo[115820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc Aug 27 04:00:07 devstack sudo[115820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 04:00:07 devstack sudo[115820]: pam_unix(sudo:session): session closed for user root Aug 27 04:00:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2b7a660-ed5d-4560-a725-1f15847ae713 tempest-SnapshotDependencyTests-1456083819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc" returned: 0 in 0.320s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 04:00:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2b7a660-ed5d-4560-a725-1f15847ae713 tempest-SnapshotDependencyTests-1456083819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 04:00:07 devstack sudo[115825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc Aug 27 04:00:07 devstack sudo[115825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 04:00:07 devstack sudo[115825]: pam_unix(sudo:session): session closed for user root Aug 27 04:00:07 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-f2b7a660-ed5d-4560-a725-1f15847ae713 tempest-SnapshotDependencyTests-1456083819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660.e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc" returned: 0 in 0.256s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 04:00:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f2b7a660-ed5d-4560-a725-1f15847ae713 tempest-SnapshotDependencyTests-1456083819 None] Lock "cinder-quobyte-e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc" released by "_delete_snapshot" :: held 1.531s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 04:00:07 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f2b7a660-ed5d-4560-a725-1f15847ae713 tempest-SnapshotDependencyTests-1456083819 None] Lock "cinder-quobyte-3eca6b3b-c91a-404b-b00f-efaf80450660" released by "delete_snapshot" :: held 1.552s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 04:00:07 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-f2b7a660-ed5d-4560-a725-1f15847ae713 tempest-SnapshotDependencyTests-1456083819 None] Created reservations ['54d30c3f-07ed-4753-9fbe-0923dc147604', '03248cba-7430-4404-bfd7-de107b4d9e47', 'a6419926-1337-4638-82d7-06888280b5a8', '343b984e-3675-4f34-b9ee-94b99bd9cdca'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 04:00:08 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-f2b7a660-ed5d-4560-a725-1f15847ae713 tempest-SnapshotDependencyTests-1456083819 None] Delete snapshot completed successfully. Aug 27 04:00:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-f2b7a660-ed5d-4560-a725-1f15847ae713 tempest-SnapshotDependencyTests-1456083819 None] Lock "cinder-e0f886d1-5e24-4d7d-b543-f3dd7cd7fadc-delete_snapshot" released by "delete_snapshot" :: held 1.687s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 04:00:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3f2ac2fa-4ea2-49a8-b39b-7cef7b14635c tempest-SnapshotDependencyTests-1456083819 None] Acquiring lock "cinder-3eca6b3b-c91a-404b-b00f-efaf80450660-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 04:00:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3f2ac2fa-4ea2-49a8-b39b-7cef7b14635c tempest-SnapshotDependencyTests-1456083819 None] Lock "cinder-3eca6b3b-c91a-404b-b00f-efaf80450660-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 04:00:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3f2ac2fa-4ea2-49a8-b39b-7cef7b14635c tempest-SnapshotDependencyTests-1456083819 None] Acquiring lock "cinder-quobyte-3eca6b3b-c91a-404b-b00f-efaf80450660" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 04:00:08 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3f2ac2fa-4ea2-49a8-b39b-7cef7b14635c tempest-SnapshotDependencyTests-1456083819 None] Lock "cinder-quobyte-3eca6b3b-c91a-404b-b00f-efaf80450660" acquired by "delete_volume" :: waited 0.014s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 04:00:08 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12995f9-a756-4c6a-bace-a12e6712cde5]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 04:00:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3f2ac2fa-4ea2-49a8-b39b-7cef7b14635c tempest-SnapshotDependencyTests-1456083819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 04:00:08 devstack sudo[115828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660 Aug 27 04:00:08 devstack sudo[115828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 04:00:08 devstack sudo[115828]: pam_unix(sudo:session): session closed for user root Aug 27 04:00:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3f2ac2fa-4ea2-49a8-b39b-7cef7b14635c tempest-SnapshotDependencyTests-1456083819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660" returned: 0 in 0.358s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 04:00:08 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3f2ac2fa-4ea2-49a8-b39b-7cef7b14635c tempest-SnapshotDependencyTests-1456083819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 04:00:08 devstack sudo[115833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660 Aug 27 04:00:08 devstack sudo[115833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 04:00:09 devstack sudo[115833]: pam_unix(sudo:session): session closed for user root Aug 27 04:00:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3f2ac2fa-4ea2-49a8-b39b-7cef7b14635c tempest-SnapshotDependencyTests-1456083819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-3eca6b3b-c91a-404b-b00f-efaf80450660" returned: 0 in 0.239s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 04:00:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3f2ac2fa-4ea2-49a8-b39b-7cef7b14635c tempest-SnapshotDependencyTests-1456083819 None] Lock "cinder-quobyte-3eca6b3b-c91a-404b-b00f-efaf80450660" released by "delete_volume" :: held 0.651s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 04:00:09 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-3f2ac2fa-4ea2-49a8-b39b-7cef7b14635c tempest-SnapshotDependencyTests-1456083819 None] Created reservations ['b6f300c3-64ce-4597-a626-92b51f144048', 'c13cb7f9-3ab0-433b-9d77-7d54a6563a6c', '375b09be-e629-44c7-a6d7-762f858ca73a', 'e0ec84a6-acfc-4ef5-9dd6-a0632d2e1ef1'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 04:00:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3f2ac2fa-4ea2-49a8-b39b-7cef7b14635c tempest-SnapshotDependencyTests-1456083819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 04:00:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3f2ac2fa-4ea2-49a8-b39b-7cef7b14635c tempest-SnapshotDependencyTests-1456083819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 04:00:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3f2ac2fa-4ea2-49a8-b39b-7cef7b14635c tempest-SnapshotDependencyTests-1456083819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 04:00:09 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-3f2ac2fa-4ea2-49a8-b39b-7cef7b14635c tempest-SnapshotDependencyTests-1456083819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 04:00:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-3f2ac2fa-4ea2-49a8-b39b-7cef7b14635c tempest-SnapshotDependencyTests-1456083819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 04:00:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3f2ac2fa-4ea2-49a8-b39b-7cef7b14635c tempest-SnapshotDependencyTests-1456083819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 04:00:09 devstack sudo[115836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 04:00:09 devstack sudo[115836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 04:00:09 devstack sudo[115836]: pam_unix(sudo:session): session closed for user root Aug 27 04:00:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-3f2ac2fa-4ea2-49a8-b39b-7cef7b14635c tempest-SnapshotDependencyTests-1456083819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.260s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 04:00:09 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-3f2ac2fa-4ea2-49a8-b39b-7cef7b14635c tempest-SnapshotDependencyTests-1456083819 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 04:00:09 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-3f2ac2fa-4ea2-49a8-b39b-7cef7b14635c tempest-SnapshotDependencyTests-1456083819 None] Deleted volume successfully. Aug 27 04:00:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-3f2ac2fa-4ea2-49a8-b39b-7cef7b14635c tempest-SnapshotDependencyTests-1456083819 None] Lock "cinder-3eca6b3b-c91a-404b-b00f-efaf80450660-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 04:00:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e51324cf-fdec-4d48-9dda-aaf3c3dc3256 tempest-SnapshotDependencyTests-1456083819 None] Acquiring lock "cinder-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5-delete_volume" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 04:00:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e51324cf-fdec-4d48-9dda-aaf3c3dc3256 tempest-SnapshotDependencyTests-1456083819 None] Lock "cinder-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 04:00:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e51324cf-fdec-4d48-9dda-aaf3c3dc3256 tempest-SnapshotDependencyTests-1456083819 None] Acquiring lock "cinder-quobyte-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5" by "delete_volume" {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 27 04:00:09 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e51324cf-fdec-4d48-9dda-aaf3c3dc3256 tempest-SnapshotDependencyTests-1456083819 None] Lock "cinder-quobyte-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5" acquired by "delete_volume" :: waited 0.015s {{(pid=94328) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 27 04:00:09 devstack cinder-volume[94328]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8abfa9a-67cd-4b7f-bf95-311d5ae65bde]: (4, 'qcow2') {{(pid=95576) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 27 04:00:09 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e51324cf-fdec-4d48-9dda-aaf3c3dc3256 tempest-SnapshotDependencyTests-1456083819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 04:00:09 devstack sudo[115839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5 Aug 27 04:00:09 devstack sudo[115839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 04:00:10 devstack sudo[115839]: pam_unix(sudo:session): session closed for user root Aug 27 04:00:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e51324cf-fdec-4d48-9dda-aaf3c3dc3256 tempest-SnapshotDependencyTests-1456083819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5" returned: 0 in 0.347s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 04:00:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e51324cf-fdec-4d48-9dda-aaf3c3dc3256 tempest-SnapshotDependencyTests-1456083819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 04:00:10 devstack sudo[115844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5 Aug 27 04:00:10 devstack sudo[115844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 04:00:10 devstack sudo[115844]: pam_unix(sudo:session): session closed for user root Aug 27 04:00:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e51324cf-fdec-4d48-9dda-aaf3c3dc3256 tempest-SnapshotDependencyTests-1456083819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4/volume-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5" returned: 0 in 0.236s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 04:00:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e51324cf-fdec-4d48-9dda-aaf3c3dc3256 tempest-SnapshotDependencyTests-1456083819 None] Lock "cinder-quobyte-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5" released by "delete_volume" :: held 0.622s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 04:00:10 devstack cinder-volume[94328]: DEBUG cinder.quota [None req-e51324cf-fdec-4d48-9dda-aaf3c3dc3256 tempest-SnapshotDependencyTests-1456083819 None] Created reservations ['baeae4e0-a187-4748-a7bc-54d70b45bac6', '30bd550e-a168-4e4c-a26c-2a900e46f381', '449a5834-4eab-40d8-868c-6ecc4fbe33a8', 'ff37c0ff-d6fd-43f5-960e-958eb17dd5a2'] {{(pid=94328) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 27 04:00:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e51324cf-fdec-4d48-9dda-aaf3c3dc3256 tempest-SnapshotDependencyTests-1456083819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 04:00:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e51324cf-fdec-4d48-9dda-aaf3c3dc3256 tempest-SnapshotDependencyTests-1456083819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 04:00:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e51324cf-fdec-4d48-9dda-aaf3c3dc3256 tempest-SnapshotDependencyTests-1456083819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 04:00:10 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-e51324cf-fdec-4d48-9dda-aaf3c3dc3256 tempest-SnapshotDependencyTests-1456083819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 04:00:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-e51324cf-fdec-4d48-9dda-aaf3c3dc3256 tempest-SnapshotDependencyTests-1456083819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 04:00:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e51324cf-fdec-4d48-9dda-aaf3c3dc3256 tempest-SnapshotDependencyTests-1456083819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 04:00:10 devstack sudo[115847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 04:00:10 devstack sudo[115847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 04:00:10 devstack sudo[115847]: pam_unix(sudo:session): session closed for user root Aug 27 04:00:10 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-e51324cf-fdec-4d48-9dda-aaf3c3dc3256 tempest-SnapshotDependencyTests-1456083819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.234s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 04:00:10 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-e51324cf-fdec-4d48-9dda-aaf3c3dc3256 tempest-SnapshotDependencyTests-1456083819 None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 04:00:10 devstack cinder-volume[94328]: INFO cinder.volume.manager [None req-e51324cf-fdec-4d48-9dda-aaf3c3dc3256 tempest-SnapshotDependencyTests-1456083819 None] Deleted volume successfully. Aug 27 04:00:10 devstack cinder-volume[94328]: DEBUG cinder.coordination [None req-e51324cf-fdec-4d48-9dda-aaf3c3dc3256 tempest-SnapshotDependencyTests-1456083819 None] Lock "cinder-fd7783d8-1dea-4f3f-8c5e-d35f15f3a1e5-delete_volume" released by "delete_volume" :: held 1.036s {{(pid=94328) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 27 04:00:14 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 04:00:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 27 04:00:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 27 04:00:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac': None} {{(pid=94328) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 27 04:00:14 devstack cinder-volume[94328]: DEBUG cinder.volume.drivers.quobyte [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-320a7055-4370-4dc1-89c5-bdfcb4ef7eac'] {{(pid=94328) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 27 04:00:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.lockutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94328) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 27 04:00:14 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 27 04:00:14 devstack sudo[115853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4 Aug 27 04:00:14 devstack sudo[115853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 27 04:00:15 devstack sudo[115853]: pam_unix(sudo:session): session closed for user root Aug 27 04:00:15 devstack cinder-volume[94328]: DEBUG oslo_concurrency.processutils [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/035a5171256f6549346f19d22fc1f7a4" returned: 0 in 0.242s {{(pid=94328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 27 04:00:15 devstack cinder-volume[94328]: DEBUG cinder.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Notifying Schedulers of capabilities ... {{(pid=94328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 27 04:00:15 devstack cinder-volume[94328]: DEBUG oslo_service.periodic_task [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] Running periodic task VolumeManager._thread_info {{(pid=94328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 27 04:00:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread count: 28 {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 27 04:00:15 devstack cinder-volume[94328]: DEBUG cinder.volume.manager [None req-4fa7f766-e97b-42ac-9862-dcc7cadc336b None None] thread info: [<_MainThread(MainThread, started 134250325188736)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 27 04:00:20 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=26,cinder:UPDATE=34,cinder:INSERT=6,cinder:DELETE=1 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 27 04:00:20 devstack cinder-volume[94328]: DEBUG dbcounter [-] [94328] Writing DB stats cinder:SELECT=24,cinder:UPDATE=25,cinder:INSERT=9,cinder:DELETE=4 {{(pid=94328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}